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AN EXPERIMENT IN THE EDUCATIONAL 
AND VOCATIONAL GUIDANCE OF 
TENTH-GRADE PUPILS 


PERCIVAL W. HUTSON 
University of Pittsburgh 
and 
ARTHUR D. WEBSTER 
Springfield Township High School 
Chestnut Hill, Philadelphia, Pa. 


XPERIMENTATION in educational and vocation- 

al guidance is eminently justified because guidance 
is carried on in thousands of schools and colleges over 
the land with very little objective evidence of its value. 
What is the worth of its various techniques, procedures, 
programs? A canvass of educational literature shows 
that investigations to answer this question have been few 
and far between. Guidance lingers long in the promo- 
tional stage, a ministry too largely accepted on simple 
faith in the unsupported assertions of its protagonists. 
Its many instruments and techniques need testing. Those 
found ineffective can then be modified or discarded. 
Those proving valid can be recommended for wider 
usage. To contribute to the fulfillment .of this need the 
research here described was undertaken. 


The Problem Studied 


The specific problem of the investigation was to find 
out what results came from the employment of a pro- 
gram of vocational and educational guidance with the 
222 pupils of the tenth grade in Lincoln High School, 
Ellwood City, Pennsylvania. In particular, it was de- 
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cided to measure the degree of attainment of the follow- 
ing goals: 
A. Making wisely the decision to go to college or 
not to go 
B. Making a vocational choice in harmony with 
ability 
C. Choosing the following elective subjects in ac- 
cordance with aptitude for them: 
1. French 
2. Shorthand 
3. Advanced algebra 


The program was carried on during the school year 
1937-38, the first year that a counselor was appointed in 
the school and guidance activity formally inaugurated. 
Choice of the tenth-grade group for measurement of the 
effectiveness of the guidance program in reaching the 
goals stated above seemed particularly justified because 
the tenth-grade pupil had various opportunities for 
choice. If he was pursuing a college-preparatory curric- 
ulum based on a decision made when he entered the ninth 
grade, he might yet change his mind and graduate from 
the general curriculum. If he had been following the 
general curriculum, in the absence of any vocational 
objective, and his ambitions had just crystallized about 
a vocation requiring college training, he could still per- 
haps realize his belated purpose by electing the right 
subject, such as French, in the eleventh and twelfth 
grades. Similarly, he could decide to take or not to take 
the shorthand and typing sequence open to juniors and 
seniors. Tenth-grade pupils in many high schools enjoy 
this diversity of opportunity for the last two years. 


Procedure of the Experiment 
The essence of the experiment was to compare the 
degree to which the eleventh-grade class has attained the 
above-mentioned goals, A, B, and C—without benefit of 
guidance—with the degree to which the tenth-grade class 
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was to attain the same goals, after being subjected to the 
guidance program hereinafter outlined. The eleventh- 
grade class was the “control” group, the tenth-grade class, 
the “experimental” group. These consecutive classes, 
numbering 249 and 222, respectively, were assumed to 
be comparable in ability. Measurements of each group, 
taken as each entered upon eleventh-grade work, proved 
the assumption to be justified. 

A. With the control group. The first steps in the 
experiment were taken in September, 1937, when meas- 
urements were made of the eleventh-grade group, and 
items of information were gathered concerning them, 
as follows: 

Intelligence—Henmon-Nelson Test of Mental Abil- 

ity ; 

Scholastic achievement — Progressive Achievement 
Test, Advanced Battery; 

Mechanical ability—Revised Minnesota Paper Form- 
board Test; 

General scholastic success—Quality point average of 
marks in all academic subjects taken in the ninth 
and tenth grades; 

Success in the study of English—Quality point aver- 
age of marks earned in English taken in the ninth 
and tenth grades; 

Success in the study of mathematics—Quality point 
average of marks earned in mathematics taken in 
the ninth and tenth grades; 

Educational plans and choice of gccupation—pro- 
cured by questionnaire. 


In addition to these items obtained on all pupils, the 
members who were beginning the study of French were 
given the Luria-Orleans Modern Language Prognosis 
Test before they had any class work in the subject. 

At the conclusion of the first semester of the school 
year, teachers’ marks were obtained for those members 
of the eleventh grade who had elected shorthand, ad- 
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vanced algebra, and French. Those who took French 
were also given a standardized achievement test based 
on the textbook they used. These measures of the achieve- 
ment of the control group were tabulated in correlation 
with the various measures of prediction listed in the 
preceding paragraph. As will be presently shown, these 
correlation tables were used in guiding the experimental 
group. 

B. With the experimental group. Without any pre- 
liminary canvass of the aspirations of the tenth-grade 
class a program of group and individual counseling was 
inaugurated early in the second semester. Weekly home- 
room guidance programs of thirty minutes’ -duration 
were conducted by the home-room teachers of these 
pupils in accordance with outlines and materials fur- 
nished by the counselor and discussed with him. Four 
weeks were spent in consideration of college going, five 
were devoted to occupation choosing, and four were 
given to study of the problems of choosing elective sub- 
jects for the eleventh grade. In addition to the group pro- 
grams, individual counseling was done by the home-room 
teachers and by the counselor whenever pupil choices 
seemed questionable and whenever pupils sought advice. 

1. Making the college decision. In taking up this 
problem, a special effort was made to help each pupil 
determine the degree to which he possessed college abil- 
ity. Since success in high-school subjects is known to be 
the best single index to college success, and since data 
are available showing this relationship in simple terms, 
the pupils’ thinking was directed along these lines. 
First, they were asked to compute from the marks they 
had earned in academic subjects in the ninth and in the 
first half of the tenth grades their quality point averages, 
using the values 4, 3, 2, 1, and 0 for the letter grades A, 
B, C, D, and E, respectively. With teacher assistance 
and careful supervision this was accurately done. The 
quality point averages were then reported and ranked 
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for the entire class from the highest to the lowest, the 
distribution was divided into tenths, and each pupil was 
informed as to the tenth of his class in which he stood. 

Second, to each pupil was given a copy of a chart 
from Johnston’s report of his investigation of the rela- 
tionship between the high-school success of graduates 
of the Minneapolis and St. Paul high schools in 1922, 
1923, and 1924, and their success at the University of 
Minnesota.’ The chart was a bar diagram showing, for 
each tenth of the high-school class, the number entering 
the University of Minnesota and the number who were 
successful. From this objective information the pupils 
were able to determine their approximate chances for 
success in college. Discussion revolved about the congru- 
ity of the analogy of Ellwood City pupils with those 
charted by Johnston, and also about reasons why the rela- 
tionship between high-school and college success is no 
more perfect or imperfect than it is. 

Besides the foregoing activity, there was some study 
of college catalogs and rather careful reading of a brief 
mimeographed booklet of information prepared by the 
counselor to answer typical questions that pupils might 
raise relative to the college decision. 

2. Choosing an occupation. Using an occupational 
analysis blank, the pupils gathered essential information 
concerning the one or more vocations which most inter- 
ested them. They were aided in using the library by an 
extended bibliography of all the occupational materials 
available, and they were encouraged in contacting suc- 
cessful workers of the community in order to obtain first- 
hand information. Oral reports to the home-room groups 
stimulated group discussions concerning occupations and 
occupation choosing. At the conclusion of this activity 
the pupils were asked to fill out a blank stating their occu- 
pational preference and their educational plans. 





*J. B. Johnston, “Vocational and Educational Guidance in the High School and 
Its Relation to Higher Education,” Vocational Guidance Magazine, VII (1928), 15-21. 
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3. Choice of elective subjects. Guidance to influence 
the pupils in their choices of elective subjects rested 
largely on the assumption that success in the study of 
French, shorthand, and advanced algebra can be pre- 
dicted to a considerable degree from the record of 
achievement in the study of related subjects taken previ- 
ously. Accordingly, double-entry tables were drawn up 
showing the relation of the success of the members of the 
control group in each of these three subject fields at the 
end of the first semester, with their success in related sub- 
jects completed in previous years. The pupils of the ex- 
perimental group were given mimeographed copies of 
these tables and were aided in interpreting them and in 
making a personal application of them. This procedure 
gave the guidance program an objective character, which, 
it seemed, would make it more influential with the pupils 
than the unsupported counsel of their teachers. 

a. French. In addition to the measure of proficiency 
in the study of English which notably forecasts success 
in the study of French, the pupils were given the Luria- 
Orleans Modern Language Prognosis Test, the same test 
which had been given the previous September to those 
members of the control group who had elected French. 
After the tests were marked, each pupil was given a card on 
which was written his score, and with it a mimeographed 
copy of Table 1, which shows, as the title indicates, the 
record of the control group in first-semester French com- 
pared with their scores on the Luria-Orleans test. 

The members of the experimental group were taught 
how to read the table, the first illustrative reading being 
as follows: “Of the seven persons who scored between 
170 and 179 on the test, about 71 per cent made B in 
French at the end of the first semester, and about 29 per 
cent made A.” Another reading, which emphasizes the 
personal application, is as follows: “If my French prog- 
nosis test score lies between 120 and 129, then according 
to the results achieved by those who have preceded me, 
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TABLE 1 
RELATION BETWEEN SCORES EARNED ON LURIA-ORLEANS MODERN 
LANGUAGE PROGNOSIS TEST BY MEMBERS OF THE CONTROL GROUP 
AND THEIR SUCCESS IN FIRST-SEMESTER FRENCH 











Number French Grades 

of 
Scores Cases E D Cc B A Totals 
by ci oes oes na 7 71.4 28.6 100.0 
I ee er 12 16.7 41.7 41.7 100.1 
EE ical ha aieaac 10 60.0 30.0 10.0 100.0 
ET ak Keiko do cea 8 12.5 25.0 62.5 100.0 
EE Gidea: ieacaes esd 10 10.0 50.0 40.0 100.0 
re eee 11 63.6 18.2 18.2 100.0 
Se 2 100.0 100.0 
a 4 50.0 50.0 100.0 
Sf a 4 75.0 25.0 100.0 
ae 1 100.0 100.0 
IN hs ae ota 4 75.0 25.0 100.0 
ME 5s crartah nec 1 100.0 100.0 

Miser banked aint 74 





I have about 18 chances in 100 of making a B, 18 chances 
in 100 of making a C, and 64 chances in 100 of making 
a D.” While home-room teachers helped the pupils to 
realize that the number of cases at each interval in the 
table was so small as to render important the factor of 
chance in their distribution, they nevertheless called at- 
tention to the general pattern formed by the 74 cases in 
the table and helped each pupil to grasp its meaning 
for him. 

The pupils were then asked to figure their quality 
point averages in English, taking marks earned in the 
ninth grade and the first semester of the tenth grade. The 
teacher put Table 2 on the blackboard t6é show the pupils 
how well members of the control group had succeeded 
in French in relation to their standing in English. Each 
pupil was helped to read the table and to interpret its 
meaning for himself in the light of his own English qual- 
ity point average. 

b. Shorthand. Shorthand teachers agree that one of 
the best predictors of success in the study of shorthand 
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TABLE 2 
RELATION BETWEEN QUALITY POINT AVERAGE OF GRADES EARNED 
IN NINTH AND TENTH GRADE ENGLISH BY MEMBERS OF THE CON- 
TROL GROUP AND THEIR SUCCESS IN FIRST-SEMESTER FRENCH 











Q. P. A. Number French Grades 

English ee E D Cc B A Totals 
A 

CRED aciccsccscas 7 $7.1 42.9 100.0 

(28-34) eer rT ee . & 10.3 33.3 43.6 12.8 100.0 

ae éévddeoededs 23 34.8 34.8 17.4 13.0 100.0 

(05-14) jeedsvonmnea 5 80.0 20.0 100.0 

(09-04) iiedevennten 

BE cdiiwtneanias _ 74 





is to be found in previous success in English. Accord- 
ingly, for the guidance of these tenth-grade pupils in 
deciding whether or not to elect shorthand, Table 3 was 
presented for their study and self-application. A similar 
table, not shown here, compared total academic average 
and shorthand grades. 


TABLE 3 


RELATION BETWEEN QUALITY POINT AVERAGE OF GRADES EARNED 
IN NINTH AND TENTH GRADE ENGLISH BY MEMBERS OF THE CON- 
TROL GROUP AND THEIR SUCCESS IN FIRST-SEMESTER SHORTHAND 











Q PA. Number Shorthand Grades 
English os E D Cc B A Totals 
A 

a  Saenrre 4 25.0 75.0 100.0 
(25-34) jehwheeteocee 37 59.5 32.4 8.1 100.0 
user gm dese dod sherds 64 26.6 31.3 32.8 9.4 100.1 
ens-14) PT eTe TT eee 13 76.9 23.1 100.0 
(00-04) bpeecensnuas 
sere rere “118 
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c. Advanced algebra. For helping pupils to decide 
on the election of this subject, double-entry tables show- 
ing the predictive significance of ninth- and tenth-grade 
mathematics and of the total academic average were 
given them, the tables being made from the records of the 
control group, as for English and shorthand. 


The Findings 

Did the experimental group, subjected to the guid- 
ance program just described, choose more wisely than 
the control group? Regarding the college decision and 
the choice of occupation, only long-term follow-up 
studies could give the ultimate answer. However, the 
effectiveness of these two phases of the guidance program 
could be appraised by comparing the two groups with 
reference to their possession of the abilities necessary for 
success in the fields in which they made similar choices. 
This step was taken, and data will be presented from 
these comparisons. Regarding the choosing of elective 
subjects, the same method of evaluation was employed, 
but it was possible also to make the more fundamental 
comparison of degrees of success enjoyed by the two 
groups of pupils. Data will be presented from both of 
these measurements. 

4A. Making the college decision. From the control 
group, 66 pupils stated that they intended to go to col- 
lege—39 boys and 27 girls; from the experimental group, 
the number was 64—36 boys and 28 girls. The college- 
going pupils comprised about 26 per cent of the total 
membership of the control group and about 29 per cent 
of the experimental group. These two groups of pupils 
were compared on several measures of ability and col- 
lege aptitude — general intelligence, achievement-test 
scores, quality point averages, and percentile ranks in 
class. Only in general intelligence were the groups ap- 
proximately equal; on the other measurements the ex- 
perimental group was definitely of superior quality. Since 
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numerous researches have demonstrated that percentile 
rank in class is the best single index in the prediction of 
college success, the data for that comparison of the two 
groups are here presented in Table 4. The most marked 
differences between the groups to be observed in the table 
proper are in the percentages of college-going pupils 
from the highest tenth of the classes and also from the 
lower half of the classes. To measure the difference in 
college aptitude of the two groups more exactly, the 
quartiles and medians of each distribution are shown at 
the foot of the table. The reader will note the evidence 
of some selection for college among the members of the 
control group, but the selection is appreciably greater in 
the experimental group. 


TABLE 4 


PERCENTAGE DISTRIBUTIONS OF PUPILS OF THE CONTROL AND 
EXPERIMENTAL GROUPS WHO STATED THE INTENTION OF GOING 
TO COLLEGE,—DISTRIBUTED ACCORDING TO PERCENTILE RANK IN 
CLASS AS DETERMINED BY QUALITY POINT AVERAGES OF GRADES 
EARNED IN ACADEMIC SUBJECTS TAKEN IN NINTH AND TENTH 














GRADES 
Control Group Experimental Group 

Percentile Boys Girls Total Boys Girls Total 
Rank (39) (27) (66) (36) (28) (64) 
MEY hiss ccgaeeacad ear 7.7 14.8 10.6 30.6 25.0 28.1 
re 20.5 74 15.2 11.1 17.9 14.1 
are 7.7 40.7 21.2 16.7 17.9 17.2 
BS ees 23.1 7.4 16.7 11.1 17.9 14.1 
Ea 10.3 11.1 10.6 13.9 3.6 9.4 
MED -dedh<<ckgewae ad 15.4 3.7 10.6 2.8 3.6 3.1 
ED “anctatsae needa 2.6 sat 1.5 5.6 7.1 6.3 
rere 7.7 3.7 6.1 8.3 3.6 6.3 
| eer. 2.6 3.7 3.0 Pee 3.6 1.6 
ee (setae eneanaawe 2.6 74 4.5 ‘ aia 
0 eer rT rr 100.2 99.9 100.0 100.1 100.2 100.2 
Upper Quartile ........ 81.8 79.3 80.5 91.8 90.0 91.0 
EE itis bad bene 64.1 73.2 68.2 75.0 75.9 75.4 
Lower Quartile ....... 45.9 55.9 49.3 56.0 62.0 58.2 





B. Choosing an occupation. A program of voca- 
tional guidance should be judged according to its satis- 
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le faction of the following two criteria: (1) the extent to 
of which vocational choices are brought into harmony with 
ro | social need, and (2) the extent to which choices are 
-4 | brought into harmony with abilities. 
le | To obtain evidence for the evaluation of the brief 
ls | guidance program on the first of these criteria, the pupils 
he | of the two groups were distributed according to the 
in | United States Census classification of the occupations 
he | they had chosen. These distributions were then paralleled 
at by the distributions of employed workers in Ellwood 
ce | City, in Pennsylvania, and in the United States as a 
he | whole. All are shown together here as Table 5. Assuming 
in that the actual distribution of the gainfully employed 
TABLE 5 
PERCENTAGE DISTRIBUTIONS OF PUPILS ACCORDING TO OCCUPA- 
ND TIONAL CHOICES AND OF WORKERS EMPLOYED IN THE SAME OCCU- 
NG PATIONAL GROUPS—IN ELLWOOD CITY (1937), IN PENNSYLVANIA 
‘IN (1930), AND IN THE UNITED STATES (1930) 
JES Experi- 
TH Occupational Control mental Ellwood Pennsyl- United 
Category Group Group City vania States 
1p NN ose iain eck webinars uae 0.9 ae 6.7 21.4 
‘otal Forestry and fishing.......... 1.6 2.3 ae 0.1 0.5 
64) Extraction of minerals........ aie wile 8.0 2.0 
— Manufacturing and 
28.1 mechanical industries ...... 17.7 14.0 66.5 38.1 28.9 
14.1 Transportation and 
17.2 communication ............ 4.0 10.4 0.8 8.6 7.9 
14.1 hans se.cusibicieg xs 4.9 10.4 11.3 12.3 12.5 
9.4 I og a wie ivaumoioenie 0.8 0.5 2.1 1.8 1.8 
3.1 Professional service .......... 36.1 27.5 4.3 6.4 6.7 
6.3 Domestic and personal service.. 4.4 6.8 4.1 8.9 10.1 
6.3 Clerical occupations .......... 28.1 26.1 10.7 8.9 8.2 
1.6 Unclassified or no choice...... 2.4 14 ae 
i SY sudinienkadsienbiencs 100.0 100.3 99.8 99.8 100.0 
100.2 
ys members of society indicates roughly the social need for 


58.2 workers in the various fields, it is evident that both the 

control and experimental groups are considerably out of 
\ca- line in their choices. Particularly, the reader’s attention 
‘tis- is called to the small percentages of pupils choosing oc- 
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cupations in the manufacturing and mechanical indus- 
tries—a category which absorbs two-thirds of Ellwood 
City workers and nearly two-fifths of Pennsylvania’s 
gainfully employed. Corresponding discrepancies are to 
be observed in the fields of professional service and cleri- 
cal occupations. In common with the findings in other 
similar studies these high-school pupils tend to over- 
crowd these fields. 

Evidence that the guidance program with the experi- 
mental group had some effect is to be observed most 
clearly in the fact that the percentage of this group choos- 
ing occupations in professional service was considerably 
smaller than the corresponding percentage of the control 
group,—a change in the right direction. Something also 
may be said for the fact that the percentages of the ex- 
perimental group choosing occupations in the fields of 
transportation and communication and of trade are more 
nearly in line with the distribution of Pennsylvania 
workers than is true of the control group. 

Table 6 presents a different classification of occu- 
pational choices, based more clearly on extent or level 


TABLE 6 


PERCENTAGE DISTRIBUTIONS OF THE PUPILS OF THE CONTROL AND 
EXPERIMENTAL GROUPS, ACCORDING TO OCCUPATIONAL CHOICES 














Control Experimental 

Occupational Group Group 

Category (249) (222) 
Sr seer Ts eee ee 18.5 13.1 
SS ER PO rere err err 18.1 17.1 
ee eS 32.9 32.9 
ed ce eartin cGaalwiaih asa ate 24.5 30.6 
EN ee Pr 6.0 6.3 
I it nits inde ie heels adie» Gane as Oma 100.0 100.0 





of training required—the professional occupations being 
those which typically require four or more years of col- 
lege or university training, and the semi-professional 
occupations typically involving one, two, or three years 
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of training beyond high school. Some advantage for the 
program of guidance is shown in this table, as the 
smaller percentage of the experimental group choosing 
professions and the larger percentage choosing skilled 
trades bring them closer to the distribution of actual 
workers than is true of the control group. 

Turning to the other criterion for evaluating voca- 
tional choice, the central question is, Did the experi- 
mental pupils choose occupations more nearly in line 
with their abilities than did the control pupils? Only a 
few coarse measurements can be offered in response to 
this question. First compared are those shown in Table 6 
as having chosen professional occupations. Since such 
individuals must have academic aptitude in a rather high 
degree in order to pursue successfully the training neces- 
sary to entering upon their chosen vocations, comparisons 
of academic aptitude were made by measuring them with 
the Henmon-Nelson Test of Mental Ability and the 
Progressive Achievement Test, and also by taking ac- 
count of their academic records in the first two years of 
high school. On the Henmon-Nelson test there proved to 
be only a slight difference between the two groups—a 
difference favoring the experimental group. The differ- 
ence was a little larger and more consistent in scores on 
the Progressive Achievement Test. On quality point 
averages, the difference between the two groups was 
marked, the summary of the distributions being as 
follows: 

Control -Experimental 


Group Group 


Upper quartile ...... 3.06 3.40 
Fee 2.47 3.10 
Lower quartile ...... 2.17 2.52 


As has already been pointed out, the last measure is the 
most predictive of college aptitude. 
Since semi-professions, as defined in this study, in- 
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volve one, two, or three years of study beyond high 
school, academic or college aptitude seems to be an essen- 
tial attribute in a person selecting one of them, just as in 
the case of the professions. Accordingly, the same com- 
parisons were made of pupils in this category as were 
made of the pupils choosing professions. Similar degrees 
of differences were found on all measures in favor of the 
experimental members. 

For the sake of making a valid comparison with num- 
bers large enough to minimize the factor of chance, pu- 
pils choosing professions and semi-professions are com- 
bined in Table 7. The basis of comparison of the control 
and experimental groups is percentile rank in class, the 
same basis as was employed in Table 4. A study of this 
table, and especially of the summary of the distributions, 
should make it clear that the experimental group was 
definitely superior to the.control group in attributes im- 


TABLE 7 


PERCENTAGE DISTRIBUTIONS OF THOSE PUPILS OF THE CONTROL 

AND EXPERIMENTAL GROUPS WHO GAVE PROFESSIONS AND SEMI- 

PROFESSIONS AS THEIR OCCUPATIONAL CHOICES — DISTRIBUTED 

ACCORDING TO PERCENTILE RANK IN CLASS AS DETERMINED BY 

QUALITY POINT AVERAGES OF GRADES EARNED IN ACADEMIC SUB- 
JECTS TAKEN IN NINTH AND TENTH GRADES 














Control Group Experimental Group 

Percentile Boys Girls Total Boys Girls Total 
Rank (37) (54) (91) (35) (32) (67) 
ED attsiageaawned 8.1 24.1 17.6 34.3 21.9 28.4 
0 ares 18.9 74 12.1 11.4 21.9 16.4 
ME Actaiaadwdra’d .. 10.8 11.1 11.0 17.1 18.8 17.9 
EE 63404-040-ce wea 21.6 5.6 12.1 14.3 12.5 13.4 
ED  wincraweamie . 10.8 9.3 9.9 5.7 9.4 7.5 
ME ncaetadeded nme 13.5 13.0 13.2 2.9 3.1 3.0 
 hwtaaekane oe 7.4 5.5 11.4 6.3 8.7 
SE hacia veh ainee ee 5.4 74 6.6 2.9 3.2 3.0 
SE hick hekawewie — 9.3 y es 3.3 1.5 
MD  wriak edhe paearndue 2.7 5.6 4.4 oie ads 
Pere ee 99.9 100.2 100.1 100.0 100.1 99.8 
Upper Quartile ....... 81.1 88.5 83.8 92.7 88.5 91.3 
BE AE daiwid a ieee 64.4 57.8 62.2 77.5 76.6 77.2 
Lower Quartile ....... 46.5 33.6 40.6 61.5 60.0 61.0 





16 











porta 
profe 
D 
chose 
skille: 
aspira 
who | 
was n 
but n 
ability 
Minn 
On th 
skillec 
Tv 
no sig 
menta 
Minne 
chose 
sional, 
other 
shown 
grades 
mathe 


Th 
value 
for sur 
guidan 
That tl 
profess 
the act 
subject 


C. 
experir 
higher 
did the 
superio 





99.8 


91.3 
77.2 
61.0 











EDUCATIONAL AND VOCATIONAL GUIDANCE 


portant to the occupations in the professional and semi- 
professional categories. 


Did the pupils from the experimental group who 
chose to enter business and clerical occupations and 
skilled trades represent a better matching of abilities and 
aspirations than did the pupils from the control group 
who made similar occupational choices? The question 
was not easy to answer. There are tests of clerical ability, 
but none were applied. There are tests of mechanical 
ability, but it seemed practical to apply only one, the 
Minnesota Paper Formboard Test, which is a group test. 
On this measurement the two groups of pupils choosing 
skilled trades showed no perceptible difference. 

Two other evaluations of vocational choice showed 
no significant difference between the control and experi- 
mental groups. One was the comparison on scores on the 
Minnesota Paper Formboard Test of all pupils who 
chose occupations involving mechanical ability—profes- 
sional, semi-professional, and skilled trades levels. The 
other was the comparison in mathematical ability, as 
shown by mathematics marks earned in ninth and tenth 
grades, of all pupils choosing occupations involving 
mathematical ability. 

That these latter comparisons yielded no evidence of 
value in the guidance program should afford no cause 
for surprise or disappointment. Certainly the vocational 
guidance hereinbefore described was indeed sketchy. 
That the experimental pupils chose professions and semi- 
professions more advisedly must be attributed largely to 
the activities in college guidance to which they had been 
subjected. 


C. Choosing elective subjects. The pupils of the 
experimental group who elected French proved to have 
higher average aptitude for the study of that subject than 
did the corresponding pupils of the control group. This 
superiority was evidenced by the comparison of progno- 
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sis test scores and by comparison of marks in ninth- and 
tenth-grade English, but more significantly by compari- 
son of marks actually earned in first-semester French. 
Distributions and summaries of the marks of the two 
groups are shown in Table 8. They were taught by the 


TABLE 8 
PERCENTAGE DISTRIBUTIONS OF PUPILS OF THE CONTROL AND 
EXPERIMENTAL GROUPS IN FRENCH, ACCORDING TO MARKS 
RECEIVED AT THE END OF THE FIRST SEMESTER OF STUDY 




















Numerical Control Experimental 
Marks Values Group Group 
(74) (65) 
Ns sind aces wid te Riad 3.5-4.0 10.8 16.9 
ON Seah k 4. tana dans ema 2.5-3.4 32.4 33.8 
ic deddcaess seadeamean 1.5-2.4 23.0 26.2 
ere ere 0.5-1.4 17.6 15.4 
eh bias iar sisi dBi aoe 0.0-0.4 16.2 7.7 
ER OT ere Er 100.0 100.0 
I 605 sede dhe canned scukesonaneeeid 3.01 3.21 
Sc cltas cde rchasreiaagaeetaesadenaduinnes 2.16 2.47 
EE 3.55 65 dedbinrckdacusseaactededases 95 1.52 





same teacher, and she was not aware that a controlled 
experiment in guidance was being carried on in the 
school. (This condition of the experiment prevailed also 
in shorthand and advanced algebra, concerning which 
data are yet to be shown.) Presenting approximately the 
same degree of contrast as is evident in Table 8 are the 
distributions of scores earned on a standardized achieve- 
ment test, the medians being 84.7 for the control group 
and 90.5 for the experimental group. 

The guidance program resulted, also, in a superior 
selection of students for the study of shorthand. Evidence 
of this outcome could be shown, if space permitted, by 
presenting a comparison of the two groups on ninth- and 
tenth-grade marks in English, and also on the language 
section (Part V) of the Progressive Achievement Test. 
Presented here, however, are only the marks earned by 
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the two groups in first-semester shorthand (Table 9). 
The differences are not marked, but they are perceptible, 
and the smaller number of failures in the experimental 
group is especial cause for gratification. 


TABLE 9 


PERCENTAGE DISTRIBUTIONS OF PUPILS OF THE CONTROL AND 
EXPERIMENTAL GROUPS IN SHORTHAND, ACCORDING TO MARKS 
RECEIVED AT THE END OF THE FIRST SEMESTER OF STUDY 




















Numerical Control Experimental 

Marks Values Group Group 
(118) (101) 

| URE NOSES a Bs eee ek: 3.5-4.0 5.1 5.9 
neha sp sa hae Seca ee 2.5-3.4 16.1 21.8 
ivicanaednsewnekeead 1.5-2.4 36.4 34.6 
See rere .. .0.5-1.4 19.5 23.8 
ttcadepaneareneacene 0.0-0.4 22.9 13.9 
MN nis caUnpecGinece mad ei eudecbnokuceedee 100.0 100.0 
I 05d cd6. 8 sid Ae + ai kia are Cee eee 2.35 2.53 
Ea hk en pea dine es ek va ued eae 1.66 1.78 
NG iad ne: Kalai aik nus sce meas Aaa 56 92 





With reference to the election of advanced algebra, 
the result of the guidance program is shown in Table 10, 
in which the superior quality of the experimental group 


TABLE 10 
PERCENTAGE DISTRIBUTIONS OF PUPILS OF THE CONTROL AND 
EXPERIMENTAL GROUPS IN ADVANCED ALGEBRA, ACCORDING TO 
MARKS RECEIVED AT THE END OF THE FIRST SEMESTER OF STUDY 




















Numerical Control Experimental 
Marks Values Group Group 
(61) ~ (49) 
Bod crit earahase'd ikke 3.5-4.0 6.6 14.3 
iia a ara ep iacalarh tia ake 2.5-3.4 34.4 38.8 
REESE gos geee .1.5-2.4 33.4 32.7 
RE OR raat: 0.5-1.4 27.9 14.3 
Ma ehigtadenalhiwneoee 0.0-0.4 sass aad 
MRE fois CALS cara oe S94 ak cia pain anemic alee 100.0 100.1 
EEE TE OPEL PEO TOA 2.91 3.17 
SE Stk cone Cnn even nox hacniniaadonen 2.16 2.53 
SN c's ads Sxceen nen eeaceeaaaeh eee .90 1.78 
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is unmistakable. To a degree this evidence was cor- 


quality point averages in ninth- and tenth-grade mathe- 
matics and on their scores on the mathematics sections 
of the Progressive Achievement Test. 


Concluding Comment 
This experiment demonstrates that a program of vo- 


cational and educational guidance can bring about an | 


improvement in the choices of high-school pupils. The 
variable in the experiment was complex, for the reason 
that a truly practical program of guidance must be com- 
plex. The decisions concerning vocation and education 
are interrelated, and they may be formed well only after 
careful analysis of self and of various avenues of choice. 
Achievement of these goals almost surely entails a num- 
ber of learning experiences. Complexity in this experi- 
ment was further contributed to by the fact that the guid- 
ance activities were performed by several persons — 
home-room teachers,—although directed by one person, 
the counselor. Certainly they varied in their capacity for 
the function, and especially they must have varied in 
their effectiveness in individual counseling. 

To control the experiment as closely as possible, 
marked emphasis was placed on objective procedures. 
Not only did this contribute to uniformity of action on 
the part of the home-room teachers, but it also facilitated 
description of the program. It is believed that the tech- 
nique of the double-entry or probability table is influ- 
ential with pupils, and it is hoped that its extensive illus- 
tration in this research will be considered to constitute 
one of the main values of the study. To predict with cer- 
tainty is a practice that should now be fully recognized 
as illusory and sure to undermine confidence in counsel- 
ing. Defensible procedure consists of showing the coun- 
selee what his chances of success are in this or that ven- 
ture. Every school should be preparing data which will 
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Of- | help its students to look for themselves into their futures. 


rend Because it is impossible to predict with certainty, it 
he- | seems unwise for a counselor to try to evaluate his pro- 
ons | gram by counting the individuals who make good choices 
» and the ones who make poor choices. No such step was 
attempted in this study. Rather, the sounder practice 
would seem to be the measurement of a group making a 

vo" | given choice to determine the degree to which they pos- 
ine sess some aptitude known to be related to success in the 
© | choice they have made. Thus, one may compare those 
Son | members of a certain group who make a given choice 
2M | before guidance with those members of the same group 
Hon | who make that choice after guidance.? The trouble with 
ity measurement before and after guidance is, of course, that 
mg such improvement in choices as may appear, may not 


pe surely be attributed to the guidance program. Therefore, 
hid comparing control and experimental groups, as in this 


“sah research, should yield more valid results. 
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wil] “A Technique for Evaluating Guidance Activities,” School Review, XXXIX (1931), 
508-19, 
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A PLEA FOR A FUNCTIONAL APPROACH 
TO TEST CONSTRUCTION 


ROBERT W. B. JACKSON and GEORGE A. FERGUSON 
University of Toronto 


- MOST of our work in education and psychology, 
we are concerned with the general problem of measur- 
ing the abilities of a group or groups of individuals. Ob- 
viously, before we can measure we must have a measuring 
instrument of some kind, and hence we must first consider 
the problems involved in the construction of these meas- 
uring instruments, which we call tests. The primary 
function of these tests is to discriminate between the 
individuals or groups of individuals tested. This ignores 
the question of the validity of the measuring instrument, 
but actually this is of secondary importance. Unless the 
test enables us to discriminate, it is clear that it can possess 
little or no usefulness as a measuring instrument. The 
purpose of the present note is to present briefly a few 
interesting points regarding the discriminatory power of 
tests, and in particular the peculiar kinds of score-dis- 
tributions which we may obtain when a test is designed 
for some particular purpose. 

For some reason or other, most of us -believe that the 
test scores should be approximately normally distributed, 
and in many cases we would discard a test which does 
not give such a distribution of scores. Possibly this belief 
is based on the assumption, generally implicit, that the 
ability in question is normally distributed in the popu- 
lation we are sampling. In constructing a test, there- 
fore, most of us choose a few very easy items, a few 
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more very difficult ones, and the rest of about average 
difficulty, and are quite happy when the distribution of 
test scores turns out to be approximately normal in form. 
It is rather unfortunate that in most cases this does not 
give us the kind of discrimination we want. We obtain 
good discrimination at both ends of the distribution, it is 
true, but as most of the scores lie near the middle of the 
distribution, it follows that for most of the individuals 
we have little or no discrimination. It may be argued 
that if the ability is normally distributed, this is as much 
as we can hope for. In so arguing, however, we forget 
that we do not know, and in fact can generally never 
hope to know, just how the ability in question is dis- 


tributed. The time has come, we think, for us to scrap | 
this idea of normal distribution of ability. What we must | 


do is to define exactly what we wish our test to do, i.e., 
define the kind of discrimination we wish to achieve, and 
then construct a test which will do exactly what we re- 
quire of it. 


Before proceeding to a discussion of some of the kinds | 


of discrimination we may wish to achieve, let us con- 
sider a particular example. In many of our examina- 
tions and tests we wish to determine some critical score 
such that all individuals receiving scores less than this 
may be classed as failures, and individuals receiving 
scores greater than this classed as successful. Now if we 
have a normal distribution of scores it is impossible to 
choose a satisfactory critical score because we know our 
examination or test does not measure accurately enough 
to enable us to make the required fine discrimination. If 
we fix 40% as the passing mark, for example, how shall 
we classify an individual who receives a mark of 39%, 
or since in some cases an even finer marking classification 
is used, a mark of 39.9%? With a bimodal distribution, 
on the other hand, we can easily determine such a critical 
score by choosing a point which lies in the range where 
the two component distributions overlap—it would be 
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better if they didn’t overlap at all, but this may be too 
much to hope for. Clearly what we wish to do in this 
case is devise a test which gives a bimodal distribution 
of scores with the critical score at some point we fix in 
advance, or possibly with a critical score such that a 
certain percentage of the individuals fall in one or other 
of the two distributions. With such a distribution of 
scores, it is a simple matter to make the required classi- 
fication of the individuals. 

Let us consider next some of the various types of dis- 
crimination we may wish to achieve, and the form of the 
corresponding distributions of test scores. 


1. Discrimination between groups of individuals 


In educational work, guidance, type psychology, etc., 
very frequently we wish to discriminate between groups 
of individuals rather than between the individuals within 
the groups. The problem discussed in the previous para- 
graph falls in this category, for instance, and there are 
numerous others. There are certain special problems in 
this group in which we wish to maximize the difference 
between the groups and minimize the differences between 
the individuals within the groups, but this is an added 
refinement which need not be discussed here. It may be 
noted in passing, however, that for this special purpose 
we want a U-shaped distribution of scores, i.e., scores 
piled up at the two ends of the scale with relatively few, 
or if possible none, of the scores falling near the middle 
of the scale. Although this type of a distribution is as 
unlike the normal as it is possible to imagine, obviously 
it is exactly what we want in such problems. 

In many problems, however, we wish to do two things: 
distinguish between the groups and also, as far as pos- 
sible, between the individuals within the groups. This 
makes the problem more difficult as the two purposes 
are opposed to each other, but a test yielding a bimodal 
distribution of scores is the type we want. The farther 
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SOE EN 


apart the two component distributions are on the scale 
the better will be the discrimination between the groups, 
and the greater the standard deviation within the com- 
ponent distributions the better the discrimination within 
the groups. By weighting these two factors according to 
the demands of the problem, we should be able to obtain 
a distribution, bimodal in form, of the scores which will | 
give satisfactory discrimination. A test of this kind might | 
be very useful, for example, in picking out children to | 
be admitted to auxiliary classes. 


ARTY en Ren Decay ic 


2. Discrimination within a group of individuals : 
The other kind of problems relates only to discrim- | 
ination between the individuals within a group. Here f 
again, however, there are several types of discrimination | 
we may wish to achieve. In these as in the previous cases, 
we must define the type of discrimination we want and 
then construct the test in such a way that exactly this 
type is achieved. We shall consider three main types in 
the following discussion. 
(a) Equal discrimination at all points on the scale 
In this type, we wish to discriminate between 
the individuals equally well at all points on the scale. 
We wish to have, therefore, a platykurtic or, if pos- 
sible, a rectangular distribution of scores, since the 
purpose in this case is to discriminate between any 
subject and those near him on the scale. As this does 
not sacrifice the discrimination at any one part of 
the scale in favor of other parts, it will give us 
roughly equal discrimination at all points. It is 
likely that this particular type of discrimination is 
the kind generally desired, but of course each prob- 
lem must be treated according to its own conditions 
and hence such a general conclusion may not be 
justified. 


(b) Greatest discrimination at one end of the scale 
In problems of this kind we are interested in 
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achieving fine discrimination at one end of the scale, 
and to achieve this are willing to sacrifice the 
discrimination at all other points. In picking out 
scholarship candidates, for example, we want par- 
ticularly fine discrimination at the upper end of the 
scale, but we are not even mildly interested in the 
discrimination at other points. For this purpose we 
want what is called a J-shaped (skewed) distribu- 
tion of scores, i.e., a distribution with most of the 
scores piled up at the lower end of the scale and 
the rest spread out in the long tail of the distribution 
over the rest of the scale. Obviously, this gives us 
fine discrimination exactly where we want it. 

We may want fine discrimination at the other, 
i.e., the lower end of the scale in some problems. 
This may also be achieved, but here we want a 
J-shaped distribution of the scores with most of the 
scores piled up at the upper end of the scale, and the 
others scattered over the rest of the scale. This kind 
of a distribution gives us fine discrimination at the 
lower end of the scale, where we want it, and prac- 
tically no discrimination over the rest of the scale. 


(c) Greatest discrimination at both ends of the scale 


Sometimes we want fine discrimination at both 
ends of the scale, and are willing to sacrifice the dis- 
crimination near the middle of the scale and for the 
majority of the individuals. In such problems it is 
clear that we want most of the scores concentrated 
near the middle of the scale, with some spread out 
over both the lower and upper ends of the scale. This 
is the type of discrimination we achieve when the 
scores are approximately normally distributed. We 
obtain better discrimination at both ends, however, 
if we arrange the test so that the distribution is lepto- 
kurtic (i.e., peaked) in form, with long tails extend- 
ing towards both ends of the scale. 
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We may want other types of discrimination in some 
problems, such as combinations of the types discussed 
above. These possibilities need not concern us here, how- 
ever, as we have covered the main types of discrimination 
required. 

The discussion so far has been theoretical in nature, 
and the reader may well ask whether or not we can con- 
struct tests giving these peculiar distributions of scores. 
The answer is in the affirmative, but there are certain 
limitations. In the first place we must have valid items, 
i.e., items which discriminate as required, in our test. 
These can be constructed. Secondly, the items do not cut 
or discriminate clearly and hence we have a “blurring” in 
the distribution of scores. These are difficulties in test 
construction, however, and we can, by proper choice of 
items, reduce the influence of these factors to a minimum. 
In this as in other fields we can never get exactly what 
we want, but we can generally obtain an approximation 
to it which gives results satisfactory for most practical 
purposes. 

It is going to be rather difficult for statisticians if tests 
yielding such peculiar distributions of scores ever come 
into general use. Most of their theory, tests of significance, 
etc., are based on the assumption of a normal distri- 
bution of the variables and could not be directly applied 
in cases such as we have considered above. This is the 
statistician’s headache, however, and is of minor impor- 
tance. We want tests to do specific jobs, and, if we can 
succeed in constructing tests which do this satisfactorily, 
we have solved our problem. The amount of work and 
trouble this gives others need not concern us if we know 
what we require and can get it. 
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TESTING IN MUSICAL EDUCATION 


res. 
ate | ROY C. WOODS 
Marshall College, Huntington, W. Va. 
ms, aail 
est. LUREATA ROSS MARTIN 
cut Public Schools, Cabell County, Huntington, W. Va. 
oy 
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test PN dicen the first wave of enthusiasm for testing had 
a passed and its numerous proponents had realized 
, that there were more significant things to be tested than 
re memorized facts, it is not surprising that a variety of in- 
: at ' genious devices should have been developed for the meas- 
ne _ urement of these more subtle factors. In time the teachers 
ca" | of music became interested in this field of research and, 

aided by other specialists, developed a variety of devices 
ests 


for use in the measurement of music knowledge and abil- 
»me ity. To date but little has been accomplished in the field 
nce, of measuring musical appreciation. A rich field awaits 
trl- "someone skilled in music and trained in testing techniques 
lied | who will attack this problem and carry through the neces- 
the sary research for the development of a valid measuring 
por- instrument. 


cas Writing as late as 1936, Gildersleeve’ stated that: 
rily, Musical performance is the common test of musical achievement. Private 
and teachers present their pupils in recital. Schools give demonstrations, con- 
certs, and operettas. Largely from these, parents, patrons, and the public 
now estimate the worth of music teaching. Through interschool festivals and 


contests, administrators, teachers, and pupils compare their own per- 
formances with those of other groups and thereby gradually evolve stand- 
ards of excellence in achievement of musical performance. 


Judging the educational value of music by group performance is not 

adequate. Other things being equal, it may be a fair assumption that the 

*Glenn Gildersleeve, Thirty-fifth Yearbook, Part IT. National Society for the 

Study of Education, (Bloomington, Illinois: Public School Publishing Co. 1936.) 
Pages 195, 205. 
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hold true... . 


finer the performance, the better the teaching, but that may not alway { 







¢ 


Since the general social standard for evaluating musical achievement i | 


inadequate, where then shall we direct the attention of parents? 


tive. 

They should duplicate the learning process and 
induce a musical response. 

They should be short enough so as not to cause 
fatigue. 

They should be easy to score, so as to take a mini- 
mum of the teacher’s time. 

They should be based on what has been taught. 
They should be impartial and objective, so as to 
eliminate the personal bias of the person giving 
the tests. 


Kwalwasser’ is enthusiastic about the contribution: 
that techniques of testing may make to the field of music 
education. He says: 


The new movement which is likely to elevate music from its low) 
estate, and win for it its belated recognition, involves the scientific stud 
of the problems of music education. . . . Applied to music education, i 
concerns itself with the learning process, methodology, analysis of talent 
problems of administration, standards of accomplishment, etc. 


Many progressive supervisors are beginning to question the adequacy 0 
their procedures, materials, and objectives. . . . They believe that thee 
processes if evaluated by rigorous measuring devices will enable us te 
improve the present status of music education. . . . 


It is fair to say that music supervisors do not know what their childre 
are achieving. . . . The entire field of music is open to investigation. 


In another reference the same author® writes: 


Probably the newest and most promising movement in the field of musi 
education is that of tests and measurement. The last ten years have wit 
nessed a phenomenal development in both the number and type of test 


* Jacob Kwalwasser, Problems in Public School Music. (New York: M. Wit 
mark and Sons. 1932.) pp. 129-135. 

*Jacob Kwalwasser, Tests and Measurements in Music. (Boston: C. ¢ 
Birchard and Co., 1927.) Pages vii, ix 
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Having thus stated the problem he continues with an/| 
outlined program for testing music designed to give ay 
cross section of music teaching. Concerning good tests in} 
music he says that: 


Good music tests should be interesting and attrac-| 
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that have been devised. The earliest tests were innate capacity measures. 
These were followed by learning tests, which measured knowledge of ele- 
mentary theory and staff notation, primarily. . . . Music tests are (now) 
both diagnostic and prognostic in function. .. . 


And Dykema‘ adds by saying that: 


All students of education who believe music to be an important educa- 
tional force should be interested in the extension to that subject of the 
test and measurement movement if for no other reason than the safe 
guarding of music teaching. 


Aptitude tests in music, according to Kwalwasser,° 
“measure elemental capacities. These capacities are 
innate. They constitute one’s musical heritage. The tests 
measure objectively the amount of talent the individual 
possesses. . . . They measure many specific musical ca- 
pacities, which when combined with many other factors 
constitute musicianship.” 

According to him® such tests would have the follow- 
ing five values in music education: 


5. 


y A 


Aptitude tests may be used for the discovery of 
talent hitherto unrecognized and undeveloped. ... 
The tests show the magnitude of individual dif- 
ferences. ... 

Aptitude tests reveal deficiencies that may or may 
not be suspected... . 

Aptitude tests sometimes reveal ear defects that 
may need immediate medical attention. . . . 
The tests may aid the pupil in selecting an instru- 
ment (upon which to learn). 


He further lists two values to the teachers of music, 
as shown by the following quotation: 


“Ibid, page ix. 
"Ibid, page 1. 
* Kwalwasser, op. cit., pages 14, 15. 


Aptitude testing may aid the teacher in adapting the training to the 
needs and nature of the child. The teacher cannot create talent when it 
does not exist, but can only utilize it when it is found. In order to teach 
the child successfully, the teacher is obliged to discover the child’s pro- 
ficiencies and deficiencies. The shortest and easiest method of talent 
analysis is aptitude testing. 


Aptitude testing may be employed by the teacher as an aid in evaluating 
the quality of a pupil’s work. A superior child may be inferior in accom- 
plishment even though he earns more than the average of the class. We 
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study are usually designed to meet the needs of the mediocre pupils and 
the superior child excels his mediocre classmates by putting forth very 
little effort. The superior child should be impressed with the fact that 


superior talent carries with it obligation of superior attainments. Unless ~ 
the teacher knows the quality of the child’s musical endowment, it is not © 


possible to evaluate the work that the child is doing. Mediocre accom- 
plishment need not mean mediocre talent. Remember that the superior 
child is usually the retarded child. Testing will reveal what you may 
reasonably expect the child to do. 


At a much earlier period, Seashore’ stated that a test- 


ing program based on scientific procedures would be the 
means by which musical talent might be found. For 
said he: 


This will secure a sort of “drag-net” survey of musical talents, as all the 
children in the community will be reached when they pass through these 
elementary grades. It will stimulate an interest in the search for talent 
and efforts in the conservation of talent on the part of all concerned, 
particularly teachers. Among the pupils it will cause a wholesome awaken- 
ing to a recognition of their particular talents. For teachers of music it 
will stimulate the recognition of responsibility for the talented children 
of the community. It will be a part of the coming system of vocational 
and avocational advice and should be a potent instrument in the develop- 
ment of community interest in music. The tests themselves constitute 
very profitable musical exercises. 


Referring to one of these dragnet surveys in another 


reference, Seashore*® maintains that: 


In all cases the first step should be the measurement of basic capacities, 
each of which measures receptivity for one of the four musical avenues, 
namely the tonal, the dynamic, the temporal, and the qualitative. In addi- 
tion to these, immediate memory, a sense of consonance, tonal memory, 
and intelligence should be measured. . . . Measurement deals with a 
specific factor which is isolable under control. This is the first principle 
of pure psychology. For example, instead of asking the question, “Can this 
child hear music?” we ask “Can he hear pitch?” “Can he hear loudness?” 
“Can he hear time?” “Can he hear timbre?” “Can he hear rhythm?” 
“Can he hear tone quality?” Each of these can be isolated for measure- 
ment; and, when we have the result, it is recordable, repeatable, verifiable, 
and predictive. What is true of hearing has its parallel on the side of 
performance as represented by skills. We do not ask, “Can he play?” but 
we ask, “Can he play a tune in time and in rhythm?” “Can he phrase?” 
“Can he produce good tone quality?” Such questions have their parallels 
at the higher levels of imagination, memory, thought, and feeling; although 
the higher and, therefore, the more complicated the process becomes, the 
more it tends to resist analysis. 


"Carl E. Seashore, The Psychology of Musical Talent. (New York: Silver, 
Burdett and Co. 1919.) Page viii. 


* Ibid, pp. 302-304. 


*Carl E. Seashore, Psychology of Music. (New York: McGraw-Hill. 1938.) 
Pages 302-304. 
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do not require enough work out of our superior pupils. Our courses of © 
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TESTING IN MUSICAL EDUCATION 


When George Eastman, of the Eastman School of 
Music, asked Seashore if there was not “something more 
positive possible” from such a testing program in the 
field of music, Seashore® replied: 


That is the great future of talent selection. When a music psychologist 
is placed in the public school system with the sole charge of attempting 
to discover, analyze, and certify talent which may be discovered by drag- 
net tests, analyzed by case histories, and verified by auditions, we shall 
be doing the positive thing in the public schools. We can then not only 
inform the talented of their valuable possession, but we can give them 
privileges in the public school musical activities in proportion to their 
capacities for achievement, and, as a result of their achievement and in 
the light of talent analysis, these pupils may be recommended to the best 
music schools. 


Larson’® outlines a musical testing activity program 
which is diagnostic, prognostic, and dynamic in charac- 
ter, similar in nature to the one suggested by Seashore to 
Eastman. Since she was a pioneer in this field, her sug- 
gestions carry added weight. In a slightly condensed 
and modified form, her suggestions as to the advantages 
of such a testing program are as follows: 


1. It enables the school system to place to best advan- 
tage the musical instruments at its disposal. 

2. It enables the school directors and supervisors of 
music to advise parents wisely in the purchase of 
instruments. 

3. It makes possible a wise segregation of pupils into 
classes according to ability, for, as she says, con- 
trary to ideas that many have had on the subject, 
it has been demonstrated that there is more incen- 
tive for the majority to work at their highest level 
when they are in a homogeneous group. 

4. It enables close study of those children who are 
supposed to have unusual ability. 

5. It gives a better check on accomplishment of both 
teaching and learning. 

6. There are a number of agencies and organiza- 
tions whose purpose is to help deserving pupils. 


*Seashore, ibid, page 323. 
* Seashore, ibid, page 323. 
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services of these groups. 
Since instrumental classes are expensive the test- 


ing program makes possible a wise limitation of f 


those pupils who ask to be admitted to them. 
She suggests further that these advantages also 





These tests will help get the maximum from the | 





accrue to classes in group singing and are not lim- | 


ited only to instrumental groups. 
Recognizing the limitations in the field of testing in| 


music education, Dykema" writes that: 


Great caution must be exercised in interpreting the results of even legit | 
mate tests. Music involves facts, skills, and emotional or spiritual expres- | 
sion. The first can be adequately measured, the second partially measured, | 
and the third as yet, probably not at all. . We may well emphasize | 
some of the more distinct values of using wisely the tests which are now | 
available. They give, first of all, an impersonal measurement. . Second, | 
they give a reliable measure of progress by using exactly the same material | 
and method of procedure in the regular class work both for teaching ” 
along lines already established, and for undertaking new work. 


& 


E 


SREUAPIPRE Y 


Fourth, they offer a means of presenting to administrative officers a con- | 


crete formulation of results which even the non-musical superintendent 
can understand. . . . Fifth, they are a spur to the children (for) definite 
measurement is attractive to all students. .. . 


That testing in the field of music education is a far 
from satisfactory solution is also recognized by Gilder- | 
sleeve’* when he suggests that: 


There are three serious limitations of teachers in the use of tests. The 
first limitation is . . . the wrong conception of the purposes of testing 
held by too many teachers. Understanding the real value of tests as in- 
dividualized classroom drills will do much toward removing this limitation. 


A second limitation lies in the inability of many music teachers to interpret 
the results of a test they have given and to show the results to a class in 
simple graphical way. . . . The science of testing is of little value to the 
teacher who does not understand it. 


A third and serious limitation is found in the incompetence of music 
teachers in constructing homemade tests and drills. Tests and drills should 
be musical and interesting, they should function with each pupil, and they 
should emphasize only those things that are essential. 


The ultimate of musical-achievement testing, as well as music teaching, 
is shown by emphasis upon the essentials for growth in music and upon 
music as contributory to sanely balanced, emotionally adjusted living. 
Attitudes, emotional reactions, and technical skills develop simultaneously. 
The types of tests suggested . . . will assist in appraising changes resulting 
from our teaching in all three of these aspects of learning. 


™ Kwalwasser, Test and Measurements in Music. Page xi. 
* Gildersleeve, op. cit., page 206. 
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Throughout all these statements runs an implication 
' of another valuable contribution which testing techniques 
real may make to the field of music education. As shown 
by quotations already made, an adequate program of 
& 


1 the | 


-~ musical instruction is dependent upon the knowledge 
of the factors constituting musical talent. After these 
factors and talents are known, and only then, can a 
good program be developed for the cultivation of 
_ | these talents. Illustrative of this use of testing de- 
18) vices is the investigation made by Martin, who used 
| these techniques for research purposes. She used the 
pa ' Kwalwasser-Dykema Music Ability Tests, which con- 
asured, | sist of five records with a single test on each side measur- 
phasize |, , 
re now) ing some phase of musical talent. The first of these ten 


ee tests test the native capacity for tonal memory. It tests 


eaching| the pupil’s power to retain and compare patterns of tones 
acon) Of varying durations. It consists of twenty-five paired 
tendent | patterns, which begin with four tones and end with nine 
tones each. The pupil is permitted to hear each pair of 
a far’ tones once, and he determines from the single hearing 
Ider-| which of the patterns are similar and which are different. 
In a similar manner tests were devised to measure the 
ts. The pupil’s ability to discriminate quality and intensity. 
testing . 
as in- As the tests grow more complex they test the pupil’s 
tation. ability to judge the tendency of a succession of tones to 
ie, Proceed to a point of rest. Time discrimination, rhythm, 
to the pitch, melodic taste, pitch imagery, and rhythmic im- 
_| agery are also measured objectively by these record de- 
—_ vices. In these tests discrimination is interpreted as the 
d they” pupil’s ability to recognize. Imagery deals with a more 
_ | subtle factor, which is the pupil’s ability to reproduce 
~— the image. They compare favorably with our recogni- 
. tion and recall types of general objective tests. The man- 
sulting ual which goes with the test records gives a detailed 
description of the tests, their meaning, and the purposes 


for which each may be used. 
35 
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Martin’™® gave these tests to 578 pupils in the sixth | 
grades of Cabell County, West Virginia, during the 
months of April and May in 1941. These pupils repre- 
sented a sampling from various types of communities so 
as to have pupils from communities that are predomi- 
nantly Negro, industrial, business, professional, small | 
town, large city, or rural. For comparative purposes | 
they were grouped so that she could determine the ef- | 
fectiveness of the following factors: : 


SSAC EET 


1. The racial factor was studied when the Negroes | 
were compared with the white children. 

2. The sex factor was studied when boys were com- 
pared with the girls. 

3. Groupings were made so as to determine if the 
type of community in which the child lived con- 
ditioned his music ability. 

4. Chronological age groupings were made to study 
general scholastic ability as shown by degrees of 
retardation in its relationship to music ability. 

5. Previous experience was studied by comparing 
the scores made by those who had had previous | 
musical training with those who had had none. 


ONO BRT ko 


Se eR 


Each of these factors probably deserves a paper by 
itself but space will permit only a brief treatment of each 
in its turn. The accompanying table was compiled from 
the data given in Martin’s report of her investigation. Al- 
though the investigation was on a scope too limited for 
generalization both in numbers of cases involved and the 
geographical area covered, it seems that some conclusions 
can be drawn that have more than passing interest to us. 

The race factor was really suggested by Seashore™ 
when he stated that: 





*Lureata Ross Martin, Factors Affecting Musical Talent in the Sixth Grade 
Pupils of Cabell County, West Virginia. (Unpublished Master’s Thesis, Marshall 
College Library, 1941.) 

™ Seashore, op. cit., page 309. 
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This type of measurement is suitable for anthropological studies and is 
likely to be enlarged and refined on a considerable scale. However, the 
present indications are that normal individuals in different cultural levels 
probably do not differ markedly in the basic capacities represented by 
these measures. 
MEDIAN TOTAL SCORES ON THE KWALWASSER-DYKEMA MUSIC 
ABILITY TESTS (From data presented by Martin) 
Number Median 
Items Cases Score 
ST 20. cosas acduwnuebsenaueeneannuianiae 106 186.27 
Ts eGo ras gira ecaswrs. Orisa sin alaiaen ase eon ae 106 177.06 
tS PE een ree 288 175.89 
SE aicanicdb aha das tsiesce wikeaes Keno ena e 288 180.75 
SE aa kod Sk os wadineén suchen eae 105 173.09 
Business and Professional* ..................+.. 105 186.33 
a iad ieeaphh sed tawed hohe semenee wn 168 181.28 
I aie Riand dasa Grek o- 9 rd aed an ace Bee he eee 168 170.0 
I fo hd Sin 'asd6:b dd asin 4b Alba wide dad wae 74 173.58 
ET ee daca vebdkdnwksarnaendatieeeb wee 74 179.5 
I sie 58.4 400d ae de cknesiecamaecereee 45 190.07 
NS 5.6 canes daduidiseueasdscnwaa eee 266 181.3 
EERE SER tay Sear Or ee eer 152 174.0 
5.5 caida ssiop oa whee Smee ee Rae 73 171.83 
ins dss dah. wks Rive 'g eka oeanne 31 167.3 
EE C8 oN b6 554k ocewnn oacuscnae wate 10 171.5 
I Ee TE a ee 123 183.75 
I PIII 60 5-50. cdk-tonsencsceseeesa 123 174.58 
EE tha ikies 4k 660 6b6d6adaeessecaen ae wee 165.65 
*Equated by random sampling. 
Using the Seashore Musical Tests, Lenoire made 


such a study in the fifth grade in 1925, which was re- 
ported by Kwalwasser.’® According to this source we 
learn that: 


. . . Aptitude tests were given to two hundred white children and two 
hundred colored fifth grade children (and that) . . . the negro was found 
far superior to the white child in rhythm and tonal memory, and not 
inferior in any of the other sensory capacities. The colored child averaged 
65.69 in rhythm, whereas the white child averaged 61.48. . . . Whether 
the negro maintains his superiority in rhythm and tonal memory in sub- 
sequent grades is a matter of speculation, for no study had been made... 
in the upper grades. 


The investigation by Martin threw some light on the 
question raised above since she confined her investigation 


* Kwalwasser, Test and Measurements in Music, page 12. Quoting from Zaid 
Lenoire, Racial Differences in Certain Mental and Educational Ability. (Thesis, 
University of Iowa Library, 1925.) 
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to the pupils in the sixth grade. She*® found that “the? I 
Negroes were ... superior to the white children inf) of ¢ 
rhythm and tonal memory, and not only in these twof 
items but superior on quality, discrimination, tonal move. | 
ments, melodic taste, and pitch imagery.” 

In studying the sex factor in musical talent, Martin" | 
found that “girls showed a slight superiority over the j 
boys in musical ability.” 

Seashore,** who found similar results, suggests that; | 


The superiority of elementary school girls over elementary school boys, | 
may probably be fully accounted for by the prevailing trait of aloofness | 
of the pre-adolescent boy toward music. These boys often regard music as d 6 
a sort of frill for girls, and therefore enter the test with less fervor than do | 
girls. Such interpretation is supported in part by the fact that in the high? amon 
school and in the university, where the girls have had far more advantage mav_ 
than the boys, the records reveal no appreciable difference for sex. y 





TA 


ng tions 
He fails to find any significant difference between f whic 


a and girls in pitch discrimination, which he says! Woo. 
oes not vary with sex to any significant extent. made 

Interesting data were found in the study of the type’ ence | 
of community factor. Martin stated’® that when she) jectiv 
started her investigation she “did not expect to find a/ In 
very great difference between the children of the indus-| took « 
trial sections of the county and the children of the busi-| to six 
ness and professional sections, since it is innate ability) variec 
which is measured and not training or achievement.”’ betwe 
Her expectations were not sustained, for she states that’ other 
“the children from the business and professional section betwe 
of the city were superior to those of the industrial group.”| pupils 
In a like manner she found” that the “urban children 








proved to have more talent than rural children ... (and) Ky 
the city children have more musical capacity than the Ph. 
7 
small town group.” | Huntingt 
© W. Va. S 
23 
* Martin, op. cit., page 8. oe 
, ) Int . 
™ Martin, op. cit., page 32. . 7 
™ Seashore, Psychology of Music Talent, pages 56-57 in Using 
* Martin, op. cit., page 47. of Educa 
* Martin, op. cit., pages 62, 74. * Ma 
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TESTING IN MUSICAL EDUCATION 


In speaking of age as a factor in the musical ability 
of children, Kwalwasser*’ says: 


Many think that musical talent is conditioned by age, but we are not 
justified in believing that age is either a help or a hindrance. Teachers 
of music frequently look with suspicion upon the tests, after they dis- 
cover that some children in their classes earn higher scores than they 
themselves do. But this revelation should not prejudice the teacher against 
aptitude testing. It is altogether possible that some children are poten- 
tially superior to their teachers in native endowment... . [Yet he says 
there are factors which aid older children and he lists them as] better 
control of attention, increased power of application, better understand- 
ing of instructions, and better adaptation for sustained effort. Psychologists 
in music do not believe that younger children are inferior to older ones 
in their spontaneous perception of differences, but that younger children 
may be inferior to older ones in their mental habits. 


The superiority which is frequently found existing 


among older children when compared with younger ones 
may be due to the factor of experience in meeting situa- 


» which the superiority is isolated for study. Bowers and 
says | 


Woods** ** ** have shown that the intelligence scores 
made by freshman in college are affected by the experi- 
ence the freshmen had had in high school, involving ob- 
jective tests of similar nature. 


In the case of Martin’s investigation the age factor 
took on additional significance. Here she limited herself 
to sixth-grade pupils and, since the ages of these pupils 
varied, it becomes an evidence of the relationship existing 
between success in school and musical talent. Stated an- 
other way, it is a measure of the existing relationship 
between musical talent and scholastic maturity or the 
pupils’ educational ages. She found”® that: 

In every test, with the exception of pitch imagery and rhythm imagery, 


™ Kwalwasser, op. cit., pp. 4-6. 

*E. V. Bowers and Roy C. Woods, A Study of the Experiential Factor in 
Objective Test Scores. Proceedings of the West Virginia Academy of Science at the 
Huntington meeting in 1937. Published by West Virginia University, Morgantown, 
W. Va. Series 38, No. 8, p. 148. 

*E. V. Bowers and Roy C. Woods, “A Study of the Experiential Factor in 
Intelligence Tests Scores,” Journal of Educational Research, XXXIV (1941), 509. 
J * Roy C. Woods, A Study of the Factors of Experience and “Earmindedness” 
in Using Objective Tests. First Yearbook of the National Association of Teachers 
of Educational Measurements, 1941, page 1. 

* Martin, op. cit., page 86. 
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the ten-year-old group ranked higher than the older groups. These chil- | 
dren were accelerated for their grade level and it stands to reason thet 
they had superior ability or they would not have been in the sixth grade, 7 
In the case of the thirteen- and fourteen-year-old groups who were aver. 7 


age for their grade level, the median scores showed their inferior ability 7 
or capacity for music. e 


In the study of the factor of previous music training | 
in its relationship to music ability as measured by these | 
tests, grave questions could be raised relative to the ques- | 
tion whether or not the tests really measured innate | 
ability. If the tests as designed by Kwalwasser realty 
measured native ability in music the previous training or | 
the lack of previous training which the pupils had had} 
would have had no influence on the resulting test scores. | 
On this point Kwalwasser”® says: 


By actual experimentation it has been demonstrated that training cannot | 
improve one’s musical endowment. . . . Training is incapable of giving an { 
individual more talent; it merely utilizes the talent that the individual § 
possesses. . . . Training will not eradicate innate musical differences. On | 
the contrary, training is more likely to magnify these differences. The 7 
individual who is more generously endowed with musical talent is likely 
to realize a great deal more, proportionately, than the individual of 
meager endowment with the same educational opportunities. This is a 
truism that many teachers fail to recognize. 


In this conclusion Kwalwasser is supported by the 
majority of authorities in the field of psychology, but the 
data collected by Martin failed to substantiate this con- 
clusion. It may be that the tests designed by Kwal- 
wasser failed to fully control the factor of previous 
learning. In that case the tests in part at least measure 
achievement as well as ability in music. Any one familiar 
with the problems of ability testing will have no difficulty 
in accepting the latter possibility. Martin®’ found that 
“the total median score for the children who had had 
outside training was higher than for those who had not 
had that extra training.” She adds that this may be due 
to the fact that “the number of pupils (she) tested was 
not significant in comparison with the number which 
Kwalwasser used to arrive at his norms.” She shows that 
the average score for those with previous training was 


aay 


et ee 





** Kwalwasser, op. cit., pages 2, 4. 
* Martin, op. cit., page 87. 
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TESTING IN MUSICAL EDUCATION 


183.75 and those without such training was 174.58. The 
Kwalwasser norm is 165.65. 

One must add that the assumption that previous train- 
ing has no bearing is further damaged when we take into 
account the fact that Cabell County, West Virginia, has 
an excellent program of musical training, which is especi- 
ally true for the cities, the largest one having the best in 
the county. This could easily account for the fact that 
in each case the norms found by Martin were higher 
than those given by Kwalwasser for the tests. The group 
having had previous training topped them all and the 
larger communities had superiority over the smaller ones. 

In conclusion, this paper has attempted to show: 

First, the value and use of musical tests in an educa- 
tional program. 

Second, The dearth of suitable devices for testing in 
this field warrants more emphasis on the future develop- 
ment of measuring devices. 

Third, In so far as we can draw conclusions from one 
small survey of musical talent we can conclude that: 

1. The Negroes are superior to the white children 
in musical ability. They averaged a score of 
186.27, while the white children averaged 177.06. 

2. The girls in the elementary school are superior to 
the boys at that level since the girls averaged 
180.75 and the boys averaged only 175.89. 

3. The types of communities in which the children 
lived seemed to have a direct bearing upon the 
scores the children made on this test. Either some 
sociological factor operated as an environmental 
influence or the children whose parents were in- 
inclined to innate musical ability had tended to 
migrate to the better communities in which to 
raise their children. This is best shown by the 
following summary: 

a) Children from the business and professional 
sections had an average score of 186.33. 
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b) Those from the largest city averaged a score | 


181.28. 


c) The small town group of children averaged a 


score of 173.58 on this test. 

d) The children from the industrial section of 
the county averaged 173.09. (It might be well 
to indicate here that the small cities in this 
county are in reality industrial centers, workers 
having moved there because of the low rents; 
in each case one industrial concern is located 
there, too.) 

e) The rural sections averaged 170.0. 

. The children most retarded in school showed the 

poorest results from taking the test. Those who 


were accelerated in school work showed superi- | 
ority in musical ability. This is shown by the fol- | 


lowing summary of data: 

a) Ten-year-old children in the sixth grade av- 
eraged a score of 190.7. 

b) Eleven-year-old children averaged a score of 
181.3. 

c) Twelve-year-old children averaged a score of 
174.9. 

d) Thirteen-year-old children averaged a score 
of 171.83. 

e) Fourteen-year-old children averaged a score 


of 167.3. 


f) Fifteen-year-old children averaged a score of © 
171.5. (It is pertinent to add that there were © 


only ten cases of fifteen-year-olds, which may 
account for the change in trend. ) 

. Children who had had previous training in music 
averaged a score of 183.75, while those who had 


been deprived of this privilege averaged only | 


174.58. Either previous training did condition the 


ability for music measured by this test or the test | 
also measures musical achievement to some degree. © 
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SCHOOL AND SEX DIFFERENCES IN 
AFFECTIVE TOLERANCE 


ROBERT I. WATSON 
United States Naval Reserve 


[* THE development of a new inventory it is impera- 
tive to present normative data from various schools and 
from both sexes. It is the intention of the writer to de- 
scribe some school and sex differences in scores on the 
Watson-Fisher Inventory of Affective Tolerance. 

Since this inventory is described in detail in a previ- 
ous article (7) only a brief resumé seems necessary. Affec- 
tive tolerance is the capacity to deal with affective ten- 
sions Or emotional excitements. The sheer capacity to 
withstand or to “take” emotional disturbance is its most 
basic aspect. In addition, there are at least two other 
capacities which make relative this affective endurance. 
These are the individual’s ability to vent or to discharge 
his affective tension, and his ability to give a subjectively 
appropriate form and direction to his release of tension. 
Affective tolerance including these aspects is measured 
by this inventory. Higher scores represent greater tol- 
erance. 

Scores of forty-five boys and forty-five girls were 
available from each of six colleges and universities. All 
were native white students drawn from the four academic 
years with a somewhat greater proportion from the first 
two years. Two of the schools were state universities in 
the Rocky Mountain area, one was a state university on 
the west coast, and another a state university in the south- 
western portion of the United States. Two private col- 
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leges, one on the eastern seaboard, and the other in the! 


middle-western area, completed the group of six schools, | 
Table 1 gives the means and standard deviations of 


wT; on ni 


the scores of the various school groups for the two sexes, | 


TABLE 1 
SCORES ON THE INVENTORY OF AFFECTIVE TOLERANCE 
ACCORDING TO SEX AND SCHOOL 











Males Females 
School N M o N M a 

D. niatiendagacuapsins 45 68.72 27.61 45 50.72 289% 
eer e ee 45 84.72 31.31 45 7161 25.9 

I. sca ieee nace eek eaairn 45 73.60 29,32 45 71.39 = 26.14 

Dida daeiinapaedaees 45 81.39 26.04 45 78.50 26.205 

Mahala acaba aie RCI 45 82.72 36.53 45 68.06 29359 
asks laa dhiossnadh aaioee 45 90.05 31.23 45 78.50 26.7208 

eo arr 270 =. 80.20 33.04 270 = 69.80 28.81 B 





The individual school means for the males range from] 
68.72 to 90.05, with a mean for the total group of 80.20. 

The means for the females range from 50.72 to 78.50, 

with a mean for all girls of 69.80. 

The question arises as to whether these differences 
in means for the various schools and the two sexes are 
indicative of real differences or whether they can be 
explained in terms of chance fluctuation in random sam- 
pling. Analysis of variance seems an appropriate method 
of testing the significance of these differences. 

Table 2 presents data on the estimates of population 
variance for school differences for male and female col- 
lege students, respectively. The estimate of variance based 


+ 


TABLE 2 
ESTIMATES OF POPULATION VARIANCE FOR SCHOOL DIFFERENCES 
IN SCORES ON THE INVENTORY OF AFFECTIVE TOLERANCE AMONG 
MALE AND FEMALE COLLEGE STUDENTS 














er Sum of Squares Estimate of Variance 
Source of variation df Males Sesnaies Mates Sasnll 
DE cite dankeaea wanes 5 13922 23460 2784 4692 
Within groups ........... 264 167044 202091 632 766 
NL i itieine- cd dae dusrecn 269 180966 225551 
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SCHOOL AND SEX DIFFERENCES 


on the school means when divided by the estimate of av- 
erage variance within the school groups yields F ratios 
of 4.41 and 6.13, respectively, for the male and female 
subjects. With 5 df for schools and 264 df for “within 
groups,” F of 3.10 is necessary for significance at the one 
per cent level. It is apparent, then, that one can be highly 
confident that the null hypothesis is false and that real 
school differences do exist. 

This does not, of course, show that all school differ- 
ences are significant. The ¢ test is an appropriate method 
of determining the significance of the specific school 
differences. The estimated standard error of a difference 
between any two school means is 5.12 for the males and 
5.82 for the females. For 264 df, t must exceed 2.576 


male subjects and 14.89 in the case of the female stu- 

M:i-Me 
dents as found by substitution in the formula ¢ = 

"Min 

The only differences which are significant at the | per 
cent level for the girls are those between School 1, in 
which the mean is smaller, and the remaining five schools. 
The school differences in the boys’ scores also show 
School | as having a significantly lower mean score than 
the other schools, except School 3, the mean of which is 
non-significantly different from that of School 1. In turn, 
School 3 has a mean score significantly smaller than 
School 6. 

It is apparent, then, that school differences do exist 
in mean score although not among all schools. No specu- 
lations will be offered as to what accounts for these differ- 
ences. It is the purpose of the writer merely to establish 
the existence of such differences. These differences bring 
out quite clearly the advisability of the establishment 
of local norms when using this and similar inventories. , 
Too frequently there is undue and unthinking depend- “ 
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ence upon the norms accompanying a test. Although it? wane 1 
is the intention of the writer to furnish norms with the nificar 
published inventory,’ school differences make advisable Table 
some consideration of this matter. . Th 

Sex differences were also investigated by the analysis) Schoo! 
of variance. Table 3 presents estimates of population) gince 




















® level. | 

TABLE 3 A cent le 

ESTIMATES OF POPULATION VARIANCE FOR SEX DIFFERENCES INV oy 0], 

SCORES ON THE INVENTORY OF AFFECTIVE TOLERANCE AMonc) S00! 

COLLEGE STUDENTS » is also 

Source of variation df Sum of Estimate ; —rws 

Squares of Variance | a char 

Te ad cal tna ddinaaialiin 1 14601 14601 ) Theret 

I ar iih ciel aan onl ciain ie ag eaenoeee 5 32380 6476 error \ 
Sex X Schools (Interaction).......... 5 4664 933 & 

BEE save caakmutadoseipte bus cincd spies 528 369135 699 In° 

een ee 539 420780 pous di 

» against 

, j , ; is high 

variance for sex differences in scores on the inventory’ ,,. pe: 


using the same college students. The kinds of variance! ..) ch, 
investigated are sex, schools, sex X schools and error! nat tok 
variance. The latter includes variance between subjects, The 


the interaction between sex and subjects, the interaction” barely 


between subjects and schools, and the interaction among) necessa: 


sex, subjects, and schools. These data on population vati-) pecesga 




















It is ap 
smn 4 differer 
THE F RATIOS BASED ON DIFFERENCES IN SCORES ON THE a 
INVENTORY OF AFFECTIVE TOLERANCE AMONG my 
COLLEGE STUDENTS » previou 
F™ Necessary for Necessary for based o 
Source of Variation F Significance _Significane |» ence be 
at 1% Level at 5% Level © S 
ee Be Oex > 
Sex X Schools + Error .........-. 1.32 3.06 2.23 Bthe § pe 
a rer 20.76 6.69 3.86 & : 
Sex + Sex X Schools ............ 15.65 16.26 661 | are elin 
Lt” 9.26 3.06 2.23 In c 
Schools + Sex X Schools ......... 6.94 10.97 5.05 | 
1. § 





*To appear shortly through the Sheridan Supply Co., Beverly Hills, California x erance | 
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» ance allow for the calculation of F ratios to test the sig- 
- nificance of the differences in the estimates of variance. 
» Table 4 presents these F ratios. 

: The first of these concerns the variances of Sex 
lysis) Schools + Error. The ratio obtained is non-significant 
ition!) since 3.06 is necessary for significance at the | per cent 

» level. Indeed, the difference is not significant at the 5 per 

* cent level, since 2.23 is necessary at this point. The sex < 
‘S INE schools or interaction variance is an error estimate, as 
is also the one labeled as error variance. The non-sig- 
nificance of the difference found shows that there is only 
rane) a Chance difference between the two error estimates. 
) Therefore it is possible to use either as an estimate of 








§ 
— : error variance. 
699 | In view of the statistical non-significance of this previ- 
‘ous difference, it is appropriate to test Sex variance 
——f against Error variance. The ratio found is 20.76, which 
is highly significant, since only 6.69 is necessary at the 
tory! one per cent level. Sex differences exist, and boys in gen- 
ance” eral show greater effective tolerance. This, however, does 
TTOr 


not take into account school differences. 
ects ‘The F ratios for Sex + Sex X Schools is 15.65, just 








tN" barely not significant at the | per cent level, since 16.26 is 
1ong" necessary. The ratio found considerably exceeds the one 
/atr® necessary at the 5 per cent level, since this value is 6.61. 
It is apparent that with school differences eliminated sex 

| differences are still significant. 
. In passing, it may be mentioned that school differences 
' previously described are confirmed in that the F ratio 
= based on Schools ~ Error is 9.26 , indicating a real differ- 


cance |} ence between schools. When the ratio between Schools 
Level © Sex X Schools is derived, it is found to be significant at 
_ the 5 per cent level, indicating that when sex differences 
1 | are eliminated there is still a difference between schools. 
. In conclusion, it would appear that: 


5 
—7a 1. School differences in scores on the Affective Tol- 
»erance Inventory exist. Not all the schools concerned in 
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this study are significantly different in mean score, but 
in general such differences are established. 

2. Sex differences in favor of the greater tolerance) 
of the males is found irrespective of school. 
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A THEORY OF VOCATIONAL INTERESTS AS 
DYNAMIC PHENOMENA’ 


EDWARD S. BORDIN 
University of Minnesota 


Since 1919, when Strong, Fryer, and his associates 
first began to struggle with the problem of their measure- 
ment (9, p. 60), vocational interests and aspirations have 
become accepted as important phenomena in the field 
of human behavior—phenomena which must be consid- 
' ered if we are to understand certain broad areas of hu- 
man behavior. It can be observed that the vocational 


goals and aspirations of an individual form one of the~ 


'mainsprings of his action. The manner in which this 


phenomenon pervades all phases of human life may be 


' illustrated in the observation that the young boy has 
_ already begun to focus his thinking in this direction as he 


goes through the stages of wanting to be a fireman or a 
railroad engineer. As an early adolescent he may think 
of himself as a professional baseball player. Still later, 
as the values and goals of adult thinking begin to take 
hold, he begins to formulate goals which he may pursue 
in his remaining lifetime. It seems axiomatic that any 
psychological thought which fails to consider this phe- 
nomenon necessarily abandons one of the rich sources of 


‘knowledge about human action. 








This paper attempts to present a theory of the nature 
of vocational interest phenomena. The form of the phe- 


*This theory forms part of the background for the research program on the 
clinical applications of the Strong Vocational Interest Blank in progress at the 
University Testing Bureau, University of Minnesota. 
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nomenon on which the discussion will focus will be the 
Strong Vocational Interest test (14). At this point in the 
development of the theory there are two self-imposedf 


limitations. First, the writer is not yet ready to generalize 


his theory in terms of the phenomena measured by other? 


so-called vocational interest tests. Such generalization? 
must await more complete knowledge of the interrela- 
tions of the various tests and the degree of identity of the} 
behaviors. Second, there will be no immediate attempt} 
to integrate this theory into some larger psychological] 
system, even though some of the relations may be appar-| 
ent. In this discussion we shall confine ourselves to thef 
following: a presentation of our theory and the contrast 
between it and other theories, the discussion of the impli- 
cations of the theory for certain aspects of vocational 
interest test behavior, and the outlining of new experi- 
ments deducible from our theory and pointing to results 
which, in some cases, would not be deduced from other} 
theories. : 
Comparison of Theories | 
Theories of vocational interest can and have taken 
one of three directions: 1. The static point of view int 
its extreme form conceives of this phenomenon as some-/ 
how reflecting a fixed biological trait. In its less extreme! 
expression, vocational interests are fixed after the indi-/ 
vidual has reached maturity. Usually, there is the idea’ 
of maturation which, of course, carries the implication! 
of biological determinism. 2. The dynamic view sees) 
vocational interests as the product of a concatenation of) 
psychological influences and, as such, subject to change) 
with changes in the equilibrium. 3. The empirical view! 
which goes no further than to say that there are sets of 
preferences which can be shown to distinguish successful 
men in various occupations from men in general. 
The last view is most descriptive of the view taken by} 
Strong.’ Since actual use of the phenomenon would neces-) 


* Expressed in conversation with the writer. 
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A THEORY OF VOCATIONAL INTERESTS 


sarily involve some assumption about its genesis and its 
implications for the future, this view does not provide a 
foundation for applications of the empirical facts. The 
applied worker is forced to make a choice between either 
of the first two views. As part of the empirical view the 
attempt is made to define the act of liking or disliking. 
Here, Fryer’s (5, pp. 348-350) early statement of the 
acceptance-rejection principle has been taken with little 
or no alteration. But the principle that individuals will 
accept or reject an activity depending on whether the 
activity is pleasant—therefore to be repeated or pro- 
longed—or is unpleasant—therefore to be avoided and 
eliminated—does not add much to our ability to encom- 
pass this acceptance-rejection type of behavior in a con- 
structive view of the problems of vocational satisfaction. 


For the broader problem of vocational satisfaction, 
either of the first two views is chosen as the basis for 
description and prediction. The static view of vocational 
interests as measured by the Strong test is well presented 
by Darley (5). After discussing theories of this phenom- 
enon as depending on achievement and as representing 
a final stage in a “recapitulation” process, he suggests that 
the most acceptable hypothesis would view vocational 
interests as by-products of the development of personality 
types. It must be remembered that in speaking of voca- 
tional interests, Darley makes use of the concept of in- 
terest types* which had grown out of his own work and 





* Our discussion will make use of this concept, but the interest groupings will 
be those presented by Strong (14). The following are the descriptive terms which 
have been tentatively applied by the counselors at the University Testing Bureau 
to the groupings which contain more than one occupation. 


Groups Description 
I Biological scientific 
II Physical scientific 
IV Sub-professional technical 
V Welfare 
VII Business detail 
VIII Business contact 
IX Verbal 
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we mean a pattern of behavior which is fixed within cer. 
tain limits after the individual is fully matured, then the | 
theory is a static one. If by personality we mean the ne 
directed strivings of the individual, then we may con- 
sider such a theory a dynamic one. 

By his discussion of the personality theory of inter- 
est types, Darley indicates his leanings toward the static 
view. He emphasizes Strong’ s summary statements about | 
his studies of age changes in interest which draw atten- 
tion to the continuity in interest patterns. Carter’s views 
are discussed with the interpretation, “The implication } 
here is definitely that the pattern cannot be changed by © 
occupational experiences, but will persist in spite of 7 
experiences basic to another pattern.” (5, p. 57.) Finally, | 
after citing a study of a small sample of vocationally mal- 
adjusted adults, he states, “It reinforces his (the clin- 
ician’s) belief in the importance of interest measure- 


ment, and it fits into the hypothesis of interests as an out- | 


growth of personality, since all of these cases had appar- 
ently possessed enough ability and special training and 
aptitude to get and hold jobs long enough to establish 
a model occupation.” (5, p. 58.) 

Carter, although interpreted by Darley as holding a 
static view of vocational interests, in the article quoted 
(2), actually presents a description of vocational interests 
as dynamic phenomena. He points out that “In the de- 
velopment of vocational attitudes the young man or 
woman is attempting a practical adjustment to environ- 
mental conditions. In this adjustment the individual is 
limited by certain external realities such as are shown by 
study of home environment, needs, personalities of 
parents and friends, and cultural resources available to 
the individual.” (2, p. 185). 
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the factor analysis studies of Thurstone and Strong. The 
treatment of interest type as a by-product of personality | 
may result in a static or dynamic theory. If by fre t 
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He also states, however, that ‘““The adjustment is also 
ality | |jmited by another class of realities outside the person’s 
ality j control, consisting of the individual’s own native equip- 
cet- | ment, physical traits, energy, mental ability, and so on.” 
1 the 4 (2, p- 185.) That Carter believes that patterns, once es- 
Z0al- | tablished may still be supplanted by new patterns is indi- 
con- | cated by the following quotation from the same article: 

In the beginning, many of the interest patterns found among young 
nter- people are very unsatisfactory solutions to their problems of adjustment. 
tatic Attempts are made to make the solutions work, but frequently this is 

impossible. After disruption of the pattern, a new pattern is developed, 
bout : and it may be a better one; if so it may last indefinitely, otherwise the 
tten- r process is repeated again. (Italics are ours.) (2, p. 186.) 
ews F It is the writer’s belief that this view of vocational 
ree interests can be refined and made more precise in such 
d by > amanner as to create a basis for a deductive system which 
- "can account for all of the known phenomena about the 
— Strong Blank and can successfully predict many as yet 
mal. : 
clin. |, Uaknown phenomena. The basic theory upon which these 
sure. deductions would be based would be stated as follows: 
out. 2” answering a Strong Vocational Interest test an indi- 
par: | vidual is expressing his acceptance of a particular view or 
and concept of himself in terms of occupational stereotypes. 
blish As Carter has suggested, this concept of the self is 

not something which appears full blown at some particu- , 

ng a__ lar stage in the individual’s development as some purely 
ioted — physiological trait might be expected to do. Rather, it 
rests is a resultant of a series of experiences in the individual’s 
> de- history which may find their focus at some early or late 
n or stage of development, depending upon the particular 
iron- combination of events. This point is clearly stated, “There 
al is_ is no single chronological age at which persons develop 
n by significant vocational interests; for different persons, the 
; of age differs.” (2, p. 187.) 
le to To further clarify the implications of the basic as- 
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sumption, two corollaries are required: 
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1. The degree of clarity of an interest type will vary) est typ 
positively with the degree of acceptance of the occupa either 
tional stereotype as self-descriptive. § fo this 

2. The degree of clarity of an interest type will vary” himsel 
positively with the degree of knowledge of the true occu-| ) the fa 
pational stereotype. phenot 
There are two hidden assumptions in the second corol- 2. 
lary, namely, that the occupational stereotypes implicit) person 
in the Strong Blank are true stereotypes of the occupa-/ | specifi 
tions involved and that all of the occupations can truly) is 4 fi 
be stereotyped. Both of these assumptions certainly/ The v 
should and actually are being made the subject of con- studies 
tinued research. vidual 

The basic assumption and the two corollaries ora Blank 
the foundation of the view of vocational interests taken), pation 
in this paper. If under personality we include the specific), ality t¢ 
long- and short-term goal-directed strivings of the indi-/ tionshi 
vidual, then this view of interest patterns may be ‘sting 
described as considering these patterns as by-products) 3. 
of the individual’s personality. We must recognize that) positiv 
these strivings are in a state of flux, changing to meet the), Measur 
fluctuations in the situation. Where the concept of the) theory 
self becomes incompatible with the present goal, a state cated u 
of disequilibrium is created which can only be resolved) ™its th 
by some reconciliation between these two factors. ) this re 

| assump 
Deductions people 

Having stated our hypothesis, we turn to the con), in suck 
sideration of its power to encompass the known data), themse 
about the Vocational Interest test and to predict new” One 
facts. We shall divide our deductions into those leading? ported 
to results already observed and those leading to hypothe-” dents i 
ses requiring experimental verification. | teacher 

> order t 
Observed > student 

1. It has been observed that there is a significant) —\;,., 

relationship between father’s occupation and son’s inter-)) experiment 
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est type (1, 7, 8). This is a result which can be fitted into 
either a static or dynamic theory. Our theory would lead 
to this deduction on the basis that a student’s concept of 
himself is likely to be affected by an identification with 
the father. A static theory is likely to predict the same 
phenomenon on some genetic basis. 

2. A number of studies have revealed that various 
personality characteristics can be shown to differentiate 
specific interest types from all others (4, 5, 6,10). This 
is a finding which is easily encompassed by our theory. 
The very nature of the personality tests used in these 
studies assures such results. These tests require the indi- 
vidual to give his picture of himself, much as the Strong 
Blank does. Therefore, where the stereotype of an occu- 
pation involves a personality trait covered by a person- 
ality test, it is logical to assume that there will be a rela- 
tionship between the individual’s response in the two 
testing situations. 

3. Several studies have demonstrated that there is a 
positive relationship between the student’s claimed and 


/ measured interest (2, pp, 21-25, 3). Not only does our 


theory encompass this phenomenon, but as will be indi- 
cated under the discussion of deductive hypotheses, it per- 
mits the stipulations of the limiting factors within which 
this relationship may be expected to vary. Only one 
assumption need be considered at this point, namely, that 
people are capable of manipulating the Strong Blank ° 
in such a manner as to present any desired picture of 
themselves. 

One study of a restricted nature has already been re- 
ported to demonstrate that freshmen and sophomore stu- 
dents in a junior college were able to manipulate the 
teacher-administrator interest pattern at will (2). In 
order to test this question further, a group of graduate 
students,* virtually all of whom had taken the Strong 


*Five staff members of the University Testing Bureau also took part in the 
experiment. 
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test previously, were asked to fill out the blank. For the 
most part, these were students in either Psychology or 


Educational Psychology who were attending a class in? 


the clinical practice of counseling. As might be expected, 


most of these students had exhibited “welfare” patterns) 


on previous testing. 


In all, twenty-five subjects took part. Five were asked | 
to simulate a medical pattern for group I, six to simulate? 
an engineering pattern for group II, five to simulate an 


accounting pattern for group XIII, four to simulate a/ 
salesman’s pattern for group IX, and five to simulate a 


lawyer’s pattern for group X. Since these subjects were} 
sophisticated with regard to the test, it was also possible? 
to talk about group names in addition to giving them af 





pivotal occupation as a frame of reference. It may legiti- 
mately be asked whether the sophistication of the sub-/ 
jects invalidates any results that may be obtained. To 

arrive at this conclusion is to make the apparently un- 

tenable assumption that sophistication with regard to the 
purposes and interpretations of the test gives one knowl-/ 

edge of the specific weights attached to any response.| 
Even if it were probable that these subjects could and! 
would memorize the complex weighting system which? 
this test has, this asumption fell down completely when} 


questioning revealed that virtually none of the subjects” 


had ever more than glanced at the weighting system and 
none had ever scored a test by hand. 

Table 1 summarizes the findings by presenting the) 
number of each level of letter grades for each of the! 
occupations in each of the interest type groupings which” 
could be observed for each of the five experimental] 
groups. The five experimental groups are defined by the” 
occupational set which was suggested to them. To illus-| 
trate, the table indicates that the five subjects who were” 
given the biological scientific interest set answered the 
Blank in such a manner as to score 14 A, 8 B* to B-) 
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TABLE 1 


SIMULATION OF FIVE VOCATIONAL INTEREST TYPES BY 25 SUBJECTS 
BY MEANS OF THE STRONG BLANK 








OBSERVED STRONG 








INTEREST TYPE IN EXPERIMENTAL INTEREST SET 
TERMS OF LETTER GroupI Group II Group XIII GroupIX Group X 
GRADES N 5 N 6 N 5 N 4 N 5 
Group I A 14 6 0 0 0 
Biological Bt+toB— 8 16 0 0 2 
Scientific C+ toC 3 8 25 20 23 
Group II A 5 15 0 (8) 0 
Physical B+ toB— 10 3 1 0 0 
Scientific C+ toC 0 0 14 15 25 
Group V A 0 0 1 1 8 
Welfare B+ toB— 1 1 5 8 17 
C+ toC 29 35 24 15 5 
Group VIII A 0 2 20 4 0 
Business B+ toB— 1 8 0 8 4 
Detail C+ toC 19 14 0 4 16 
Group IX A 0 0 2 12 12 
Business B+ toB— 2 2 7 0 4 
Contact creoc— 13 16 6 0 0 
Group X A 1 0 0 4 13 
Verbal B+ toB— 11 4 0 7 2 
criec— 3 14 15 1 0 





and 3 C+ or C grades on the occupation keys included 
in this interest group. 

By noting the extreme preponderance of A grades 
for the occupations included in the interest type defined 
by the particular experimental set, we see that without 
exception the subjects were successful in simulating the 
interest type required. In questioning the subjects as to 
the method used in the simulation, the invariable re- 
sponse was that they had answered in terms of their 
impressions of what the typical salesman, doctor, etc., 
would say. In other words they were expressing their 
stereotype of a salesman, doctor, etc. Further inspection 
of Table 1 reveals that the stereotypes of a doctor and 
engineer are quite interrelated, that the stereotype of a 


_ business detail worker seems to be the most independent 
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of other interest types, that the stereotype of a verbal 7 
interest type occupation is almost identical with the J 


stereotype of a business contact type, although the re- 
verse is not true. 


This evidence is clearly consistent with our original © 


theory and provides a basis for deducing a relationship 


between claimed and measured interests. Although we 
must reject the objection that a sophisticated group f 
would be able to simulate interest patterns because they 
knew the weighting system, we would have to accept the | 


statement that this group was atypical in that it was 
more likely than an ordinary student group to be ac- 
quainted with the true occupational stereotypes. How- 


ever, this acceptance does not preclude the possibility 


that ordinary persons would also know the true occupa- 
tional stereotypes. In the writer’s clinical experience one 
case stands out quite clearly. This student was taking pre- . 
medical work and had filled out a Vocational Interest 7 é 
Blank which showed a “welfare” pattern and very little | 

resemblance to men in scientific occupations. In talking © f 
with this student, the writer asked him to describe his 
idea of a doctor. The student prefaced his description by 

stating that what followed was his :dea/ of a doctor and F 
proceeded to describe a “welfare” type. When asked to) 
describe what he thought doctors are really like, he then” 

described the scientific type of person. He was then asked © 
to fill out the blank in conformity with his conception of 7 
what doctors were really like. The scoring of this test 
revealed a typical scientific pattern and an almost com- 
plete elimination of the “welfare” resemblance. Many? 
similar clinical experiences where students had filled out | 
the blank with a new set have convinced the writer that 7 
the completion of projected studies of interest pattern! 

simulation by undergraduate students will reveal the” 
same results, though in lesser degree, as were reported | 
here with regard to graduate students. ed 


rs: 
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rbal F 4. One of the major facts which Strong has estab- 
the » lished concerning his blank is the continuity of interest 
re-) patterns (13). In general he has found that these pat- 
» terns become more stable as the group studied is older. 
' Reading in between the lines of most discussions of the 
interest test phenomena, this fact is taken to mean that 
Strong interest patterns are fixed, once developed, and 
therefore any actual changes are due to unreliability or 
other types of error. But our theory can encompass the 
same phenomena without recourse to the catch-all concept 
of error. First of all, we assume that it would be acknowl- 
edged as a social-psychological and sociological fact that 
the older the individual is, the more likely it is that he will 
have established himself occupationally and the less likely 
it is that conditions will require a change in this occupa- 
tion. This would be particularly true for the college 
» populations which have formed the major source of 
re- |) study. Where individuals do show changes, we can cor- 
rest relate these with changes in his situation and goals rather 
ttle) than ascribe them to error. 








Pe * 5. A final known fact about the Strong Interest test 
by phenomena is that small positive relationships may be 
a ' found between interest scores and performance on 


3 achievement tests or grades in courses (11). Some, no- 
tably Fryer, have contended that the study of the amount 


7 ' of information that an individual has in each field would 
"al be the best avenue for the estimation of his interests. 
. of & 


_ Our theory would suggest that an individual’s informa- 
test) tion and achievements would represent only one of many 
m- potential factors in his interests and therefore could have 
any only a limited contribution to the understanding or es- 
out timation of vocational interests. However, we should 
hat)) point our that our second corollary suggests that another 
em) type of information plays an important role in the man- 
' ifestation of an interest type, namely, the information 
_ about occupational stereotypes. 

Thus we see that accounting for these basic known 
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facts about Strong Vocational Interest phenomena places= It 
no undue strain upon our theory. No claim is here made | | these 
that we have systematically surveyed every study which# betwe 
has been performed on this instrument, but we have in-¥ coroll 
cluded what seem to be five basic and well established F has b 
facts. > sumec 
Predicted / much 

' .... | would 
We come to the severest test of a theory, its ability) siataee 

to open up new directions of research and to predict out- © b 

: } . © becor 

comes. All of the hypotheses which will be presented in 2 
this section will represent feasible studies, some of which# : 
are already in progress as part of the program of research? — 
in the clinical applications of the Strong Blank whichis— TI 
being conducted in the University Testing Bureau, Uni-? — 
chara 


versity of Minnesota. It is hoped that other interested ¥ 
psychologists will attempt to check the adequacy of these | S It 
hypotheses. ’ static 
The basic assumption and its two corollaries which) well « 
have been stated above form the origin of the set of/ terest 
hypotheses which follow: > guns ; 
4 ’ 
1. Hypotheses with regard to relationships between | a. 
father’s occupation and son’s measured interest: » While 
The more social status attached to father’s occupation, | ) sis, th 
the greater the relationship. " cepts 


The closer the emotional bond between father and > findin; 


son, the greater the relationship. BD stion 
io 

The longer the occupation has been in the family, the) 7 dence 
greater the relationship. ‘ticity. 
What amounts to an over-all hypothesis would be 3. 
stated as, the greater the identification with the father, tween 
the greater the relationship will be. A 


Where the son feels inferior to the father, there is) hypotl 
likely to be a discrepancy between father’s occupation), the oc 
and measured interest. » betwee 
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laces) It can be seen that the basic variable underlying 
nade! these hypotheses would be the degree of identification 
hich © between father and son. In this set of hypotheses, the 
e in-) corollary with regard to knowledge of the stereotype 





shed has been neglected to the extent that knowledge is as- 
' sumed to be at a maximum. This avoids introducing too 
' much complexity in our hypothesis. However, any study 
' would need to consider both corollaries, meaning that 





lity § several hypotheses must be considered at once. This will 
rr * become clearer as the predictions are developed further. 
a | 2. Hypotheses with regard to relationships between 
arch), Personality and interest type: 

chis) Those occupational stereotypes which involve some 
Uni-) differentiating personality characteristic will reflect that 





ested characteristic on tests of the trait. 


these), It is felt that the relationships between the relatively 
" static personality traits and interest types has been fairly 
rhich’ well explored. Deeper insights into the dynamics of in- 
et of! terest types should come from the leveling of our research . 
» guns at the question of the development of the individ- 
 ual’s concept of himself as reflected in his goal-directed 
ween" strivings and the effects of the barriers he encounters. 
» While we cannot state it clearly as a deductive hypothe- 
tion, sis, there seems to be the possibility that some self con- 
"cepts are more easily discarded than others. Strong’s, 
and) ‘nding (13) that correlations of tests taken in the senior 
year in college with retests five years later varied by occu- 
' pational scale from .50 to .80 may be interpreted as evi- 
y, the dence supporting the possibility of variability in the elas- 
" ticity of self concepts. 
d be 3. Hypotheses with regard to the relationship be- 
ther, tween claimed and measured interest: 


oR 


A restatement of the corollary gives us our basic 

‘re is hypothesis, namely, that the greater the knowledge of 

ationly the occupational stereotype, the greater the relationship 
» between claimed and measured interests. 


61 





EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 


the more specific will be his interest type. 


This hypothesis requires further explanation. By/ 


specificity of interest type, we refer to the phenomenon 
of individuals who show a very close resemblance to one 


occupation within the interest type and virtually no re/ 





The more specific the individual’s knowledge of ani} 
experience with a particular occupational stereotype | 


semblance to the other occupations in the interest type) 


There will be a greater incidence of specific interes 
types among older subjects. 


This hypothesis and the one that precedes it should) 
be tested together since they are clearly interdependent) 


Those occupations in which the workers are mort 


stereotyped will exhibit a greater relationship between) 


claimed and measured interest. 


Those occupations in which the workers are mor 
stereotyped will show a greater test-retest correlation 


4. Hypotheses with regard to the continuity of in 


terest type: 
If we divide a college population, all of whom hav 
been tested and retested on the Strong Blank, with a 


appreciable interval intervening, into the following 


groups: 


a. those who were following curricular plans conso 


nant with their interest type at the first test and continueé 
with these plans in the intervening period, 

b. those who were following curricular plans con 
sonant with their interest type at the first test and changet 
to a curricular plan not consonant with the first test dur’ 
ing the intervening period, 

c. those who were following curricular plans not cor 
sonant with their interest type at the first test and changet 
to a curricular plan which was consonant with their fir 
test in the intervening period, 

d. those who were following curricular plans nif 
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consonant with their interest type at the first test and 
continued with these curricular plans during the inter- 
vening period, 

e. those who were following curricular plans not 
consonant with their interest type at the first test and 
changed to some other curricular plan still not consonant 
with their first test in the intervening period, 
the following hypotheses are deduced: 

Group a will show the greatest test-retest correlation. 


Group c will show almost as high or even just as high 
a test-retest correlation as group a. 

Groups 6 and e will show the lowest test-retest corre- 
lations. 

Group a’s test-retest correlation will probably vary 
within the limits set by group a and group b. 

These deductions involve the idea that a change in 
curriculum and consequently a change in goals will prob- 
ably involve an adjustment of the individual’s picture of 
himself. Where the change involves a turning toward a 
well established picture, then no change in the interest 
type would be expected. The more drastic the change in 
occupational orientation, the less relationship would be 
expected between test and retest. 

The experiment which embodies the test of the above 
set of hypotheses seems to be one which is crucial to the 
choice between the static and dynamic types of theories. 
Exponents of the static view must necessarily assume 
that curricular experience, particularly at the college 
level, should have little or no effect upon the stability 
of the interest pattern. If it can be shown that the above 
set of hypotheses, representing a systematic account of 
changes in relation to curricular experiences, are at all 
tenable, then the dynamic theory would be well on the 
road to establishment as the most acceptable explanation 
of vocational interest phenomena. If these hypotheses 
should fail to be substantiated, it still would not represent 


63 


—_ 








EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 






a permanent setback to the dynamic theory, providing® catio1 


the majority of the other hypotheses presented in this) colle 
paper are proved tenable. In being capable of providing) jnsigl 





a logical basis for the deduction of the large number of? moti 

new experiments embodied in our hypotheses, this theo- 

retical approach has already established its contribution? 1. B 

Significance for Counseling 2 ¢ 

Some psychologists who have leaned heavily upon the} 

Strong Vocational Interest Blank in their clinical work) 3+ © 

may feel that if the dynamic theory is substantiated the! 

Blank will lose its value. This view is likely to result? 4 p 

from a consideration of vocational interests as contribut-) 

ing a rather fixed characteristic of the individual in the) ‘ 

same manner as aptitude tests. The usual frame of refer§ ~~ 

ence is that the clinician’s major purpose is to arrive at 

a prediction of the individual’s vocational success or satis| 6. Dr 

faction. However, few of these workers would disagree! 

that the knowledge of the goals which motivate their! . Ds 

clients is of prime importance for clinical work. Thay — 

these goals cannot be accepted as fixed characteristics) 

if evidence indicates that such be the case, is a necessary) 8. Fo 

assumption if the clinician is to avoid bad errors in his 

predictions of vocational satisfaction, or even worse) 9 Ff, 

avoid the error of having operated persuasively on | 

fallacious assumption. 10. Sar 
In the writer’s opinion any loss to this instrument in 

terms of long-term prediction will be more than com jj, ¢¢, 

pensated by the clinical insights which may be gained 

from a consideration of the phenomena hypothecated 

This opinion is based on the assumption that one of the 

prime functions of the clinical psychologist is to aid the 12, Ste 

client to develop greater insight into his feelings and 

motivations as well as his abilities and aptitudes. Thes! — 


insights should then lead to an increase in the client’! 
ability to formulate goals which will lead to maximum 14. 
satisfaction. In this frame of reference, the Strong Vo 
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iding » cational Interest Blank is an excellent instrument for the 
1 this) collection of information about and the development of 
idingy insight into one of the important sources of human 
yer off motivation. 
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NOTE ON THE RELIABILITY OF 
RATIO SCORES 


LEE J. CRONBACH 
State College of Washington 


“JN A PREVIOUS ARTICLE,’ problems involved in 
|i studying the reliability of ratio scores were discussed, 
i and methods of computing the reliability presented. The 
present note describes two procedures of some theoretical 
‘interest, but little practical importance. 

Constant denominator method. The formula pre- 





| sented previously is not valid for ratios Z unless the varia- 


tion of the group in } is small compared to 3 itself. For 
F values of 6 which do not satisfy this condition, an ap- 
| proximate approach known as the “constant denomina- 
* tor” method may be used. Except for groups where every 
"student has the same denominator score as a result of 
' testing conditions, this method gives only a rough esti- 
/ mate of the reliability. It was indicated in the earlier 
article that the reliability of the ratio will vary with dif- 
' ferent values of 6. Within any large group, it should be 
© possible to obtain estimates of the values of the reliability 
“corresponding to different b-scores represented in the 
range. This is accomplished by dividing the total group 
into sub-groups, each of which contains students whose 
_ b-scores range over only two or three points. In each sub- 
"group, except where 5 is exceedingly small, the standard 

deviation will be small compared to the mean of b. For- 


—s 


Cit khong che ee 


inten 








j *Lee J. Cronbach. “The Reliability of Ratio Scores,” Educational and 
2 Psychological Measurement, I (1941), 269-278. 
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mula (4) or (7) from the previous article can be appliei) 
to each sub-group in turn, yielding an estimate of th) 
standard error of measurement of the ratio corresponding) 
to the mean value of 4 in the sub-group. If one can assum 
that for the test studied r,, is independent of a and r,) 


is independent of 6 (this is the common interpretatiof jnato: 


of reliability), values of these statistics computed for thi 
total group may be used for the sub-groups after applyin| 


Kelley’s correction for the changed variability of th) 


group. Only the means, standard deviations, and r,, neei)_ 


be computed for each group. If a large number of casel 


is available, it may be possible to select sub-groups each 


containing only students whose b-scores are equal. In thi 
case, v,=0 and formula (4) becomes 


Foo ™ Tene (8) : 
nT) 





r,, can be computed for each sub-group, or obtained fron} 
the value based on the total group. 

If estimates of the reliability are obtained for sizeabk 
sub-groups scattered over the entire range of scores, it i) 
possible to plot the standard error of measurement of tht 
ratio against 6 and fit the points so obtained with @ 
smooth curve. It is desirable to plot the standard error of” 
measurement rather than the reliability, against 5, as thi 
reliability varies with changes in the spread of th 
group.” 

It will be noticed that the procedure outlined her 
tacitly assumes that the reliability of the ratio depend 
only upon errors in the numerator, i.e., that the unrelia/ 
bility of the denominator does not effect the reliability o! 
the ratio. This is only true where the denominator is nol 
a variable. Probably no serious error is introduced wher 
the denominator score, while a variable, is highly relia 





* This plotting procedure, in which different standard errors of measur 
ment are reported for different positions in the range, resembles a metho 
described by J. C. Flanagan for use with scores of the usual type, where ratia” 
are not involved. See J. C. Flanagan, Scaled Scores. (New York: Cooperatin) 
Test Service, 1939), pp. 15-16, 30. & 
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NOTE ON THE RELIABILITY OF RATIO SCORES 


ble. In this case, one would expect that error in the ratio 
would arise largely from errors in the numerator. This is 
illustrated by such a denominator score as C. A., which 
can usually be determined without error. As the reliabil- 
ity of the denominator decreases, the constant denom- 
inator method becomes increasingly inaccurate. If errors 
in the numerator are likely to be correlated positively 
with errors in the denominator, the reliability reported 
is probably too low. If errors in the numerator have a 
low or negative correlation with errors in the denomina- 
tor, the obtained estimate of reliability will be too high. 

Integration method. It has been pointed out that one 
cannot speak of “the reliability of a score” as a value 
which applies equally well to any ratio within the popu- 
lation. How great the error of measurement of any score 
is likely to be varies with the score itself. A fairly pre- 
cise but laborious procedure which acknowledges this 
fact is the integration method which may be used where 
a+c=b. This case is frequently encountered in per cent 
accuracy scores, where 4 is number attempted, a number 
right, and c number wrong. It is necessary to assume that 
errors of measurement in a and ¢ are normally distrib- 
uted ; this condition is probably not satisfied when the dis- 
tribution of 6 is skewed, as when most students attempt 
all items. 

Required ar€ Gps meas, and 7,,. One assumes that 


all values of a;, c; obtained by repeated measurement of 
any individual will be distributed normally about the ob- 
tained scores a}, cj, and that Tae, = Tag One may assume 


ae 
that Fo,= Omens,» and that Te, = Fmeat,9 unless there is reason 
to believe that the reliability of a or c varies with the size 
of aorc. In that case, values for o, and ¢, must be ob- 
tained directly from a group of cases having scores at 
or near a; or c;. One may conceive all possible values of 
4;, ¢; such as would be obtained by repeated measure- 
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ments as plotted in a frequency surface with axes a and; 


a; a; 
"5B; aye; 
any given value 7;+¢, one needs but to integrate the nor.) 
mal two-variable probability function as follows: 


exceeds 





To determine the probability that ; 
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—1 (4-4) 4 GG _ Wee (a;— aj) (c¢;—¢;) ) Personi 

rm a. e. Ga, Fe; ) | present 

, | briefly 

Si , : - 1 «fm you be 
ince a separate evaluation of the integral, which ish} - 

mathematically laborious, for each set of scores a’, c’, 79 ing wt 

and¢ is required, the method is not likely to be practical wong 

for most purposes. [= “4 

Both of the methods presented here serve to empha) pr “ 

size the fact that the reliability of any ratio score is ay reget 

function of the size of the denominator. From this, it bef Pinan 

comes clear that one cannot obtain a reliability coefficient dose 

for a ratio score and expect that coefficient to be equally> Re 

applicable to all scores in a sample. Under certain condi- 7 i 

tions, as set forth in this and the preceding paper, such af a‘ 


reliability coefficient may be meaningful, but in general 
it must be recognized that determining the reliability of! ee. 
a ratio score is a problem requiring careful analysis and) 
interpretation of results. 
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WARTIME ACTIVITIES OF PERSONNEL 
WORKERS IN THE AUTUMN OF 1942? 


N SEPTEMBER 25, 1942 the following request 
was sent to all members of the American College 
Personnel Association: “Describe in brief terms your 


present responsibilities in the war effort. Please tell 
| briefly what you as a personnel officer are doing, whether 
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| you be in the armed forces or whether you be participat- 


ing as a civilian. Do not hesitate to list some of your 


' normal functions which are directly connected with the 
' war. For example, many of you may be continuing your 


responsibility for counseling students by giving in this 
responsibility special emphasis to orienting students in 


| the role they should play in the war. This is war effort. 
Please list all of your responsibilities which are in any 


way connected with the war.” 

Replies were received from 115 persons. An attempt 
has been made to organize the activities mentioned in 
such a way that the outlines may serve as job analyses of 


* Prepared by Grace E. Manson, American College Personnel Association Editor, 
an announcement from whom follows. 

The American College Personnel Association has at long last reached one of 
its goals. It has an official organ. Through the wisdom and initiative of Dr. Wil- 
liamson, Dr. Feder, and the Executive Council, and with your hearty approval 
(99 per cent in favor), an arrangement has been made with Educational and 
Psychological Measurement whereby a certain amount of space in each issue will 
be allotted to the Association. Articles are solicited which will make a contribution 
to the attainment of the purposes of personnel work as defined in the charter of 
the A.C.P.A. 

During these strenuous times when an increasing number of our members will 
be away from their usual positions and when meetings of the Association may be 


' cancelled, it is important that we hold together our interest in personnel work and 


in one another. It is to be hoped that articles in the Journal will aid in accomplish- 
ing the first objective and that a section devoted to news notes will aid the second 
objective. You are therefore urged to send both articles and news notes to your 


| editor, Grace E. Manson, Northwestern University, Evanston, Illinois. 
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at work in the colleges, the analysis of work done in the 
educational areas is the most reliable one. During the fall 
of 1942 enrollment in most colleges had not dropped 


sharply but the male students, though still on campus 


were entering the reserves. Rumors were afloat that 
women would be registered for war work, but no govern. 
mental action had as yet been taken. A similar survey 


made in the fall of 1943 may show interesting change 
in how college personnel workers distribute their time) 


and effort. 


The informal nature of the inquiry yielded data 
which did not lend themselves to refined statistical analy- 
sis. There seemed to be considerable variation in what 
individuals considered important enough to mention) 





personnel work done in contributing to the war effort in 
the fall of 1942. Since the majority of workers were stil] © 


ee 


—_ 


eee ere a 





The variety and form of expression, often in terms of the} 


local situation, made it difficult to be sure of the inter- . 


preted meaning. However, the results indicate definite | 
trends. 


The outlines have been built up empirically. They are| ; 


on a functional basis and a count has been made of the! 


number of times a duty was mentioned or implied. The} 


subjective interpretation of the classifier undoubtedly! 


brings in a considerable margin of error. The job analysis 
outlines will be given in the following order: 


(1) Activities of personnel workers in the armed 
services. 


(2) Activities of personnel workers in the govern- 
ment. 


(3) Activities of personnel workers in industry. 


(4) Activities of personnel workers in private non- 
profit personnel organizations. 

(5) Activities of personnel workers in educational 
institutions. 
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WARTIME ACTIVITIES OF PERSONNEL WORKERS 


ort inf Activities in the Armed Services 
© still) Eleven members of the A.C.P.A. who had entered the 
n th! armed services replied. 

e fall 3 were in the Army 

pped F 7 were in the Navy 


Bins os 








npus, f 1 was in the Marines 
that Regulations permitted descriptions of duties only in 
vern-¥ general terms. In summary form, the functions with the 
itvey= times mentioned were: 
angG § Recruiting (1) 
time | Selection and Placement (10) 
Training (4) 
data} Neuro-psychiatric services (5) 
naly- | Research (3) 
a Table | gives the detailed analysis. 
pf the | TABLE 1 
nter- ACTIVITIES OF PERSONNEL WORKERS 
init IN THE ARMED SERVICES 
Number Times Mentioned 
fT ee er ree Te eee ere l 
y art 6B. Selection and placement................ l 
f the) ee reer er ree 3 
The} FR er eT re 2 
tedly | er rere rer 2 
Lysis 4. Occupational classifications ......... 2 
C. Training 
anal eS errr rere Tee eT l 
SSR Serr rr mae ] 
3. Educational guidance .............. l 
yern- 4. Counseling on personnel problems.... 1 
D. Neuro-psychiatric services 
vy, cha eee ae kabeewew ee 2 
; i ES OOO ss xa sco dacenceases l 
non- ia vey cataeeenneebens 2 
E. Research 
onal ie CONOR ois ec ecessesees l 


2. Analysis of failures ................ 
















EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 


Activities in the Government 


Two members of the A.C.P.A. reported that they ) 
were doing government work. One was with the USF 


Employment Service, the other with the War Manpower 
Commission. Their duties are given in Table 2. 


TABLE 2 
ACTIVITIES OF PERSONNEL WORKERS IN GOVERNMENT 





Number Times 
Mentioned 


A. Job analysis and classification........... 2 


B. Training 
1. Setting up of service training programs 1 





Activities of Personnel Workers in Industry 


Three members who were doing personnel work inf 
industry reported on their activities, which are listed inf) 


Table 3. 


TABLE 3 
ACTIVITIES OF PERSONNEL WORKERS IN INDUSTRY 





Number Times 


A. Administration Mentioned 
1. Problems due to change to production 
SED dc05casadpcesenaenenee 2 
2. Problems due to loss of technically 
trained staff officers to armed services 
and government work............... 2 
B. Hiring 
1. Recruiting in a scarce market........ 2 
2. Selection 
CED iv icdcswadnesdecens 2 
b. Employees for new jobs.......... 2 
C. Training 
FE reer Tee re ree l 
2. Women for men’s jobs.............. 2 
D. Orienting 
1. Beepenm wp morale... .....cccccccccs | 
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WARTIME ACTIVITIES OF PERSONNEL WORKERS 


Activities of Personnel Workers in Private Non-Profit 


they § 
USE Personnel Work 


ower fe Five replies were received from members who were 





| doing work with service organizations or on a private 
| basis. Their activities are given in Table 4. 
— TABLE 4 
os § ACTIVITIES OF PERSONNEL WORKERS IN PRIVATE 
NON-PROFIT PERSONNEL WORK 
Number Times 
: Mentioned 
___— A. Setting up service programs............ l 
OORT RR l 
ai | B. Giving occupational information 
i ae Bree reeeeerereerrri errr 2 
FORCE CTCL CL EOC 2 
i a eh at l 
| C. Educational guidance 
es dg Galle Wok hier he Bk Maeledea l 
as os a oe Kab aaa’ l 
errr errr rr ers 2 
E. Training for personnel work............ ] 
ER ere Pe Tem nee 1 





. Wartime Activities of Personnel Workers in 
Educational Institutions 


‘ By and large the greatest number of members were 
' working in educational institutions. Ninety-four of these 
sent information about their wartime activities. These re- 
| plies have been analyzed and classified in Table 5. Table 
| 6isasummary of Table 5 showing the order of emphasis 
| in terms of the number of times the activity was men- 
» tioned and its percentage of the total activities mentioned. 
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TABLE 5 
WARTIME ACTIVITIES OF PERSONNEL WORKERS 
IN EDUCATIONAL INSTITUTIONS 





1. 


ARWr 


Number Times 
Mentioned 


i, Se kd cab awewndewe ve 
Usual functions ............ccccece, 9 


2. Additional duties arising out of 
a. 


Loss of trained staff members...... 


b. New assignments ............... 


B. Liaison work with 
Armed services .................05- 26 
ED a sp nees ace daewseee 3 
a ae a ik al oh has 6 
U. S. Office of Education............ 


nite erat a AE 


a. 


C. Campus Committee work 


1. Faculty-Student personnel committees 
i RE 6 bc bi cdawaadenkee’ 
ee | ee rere er 5 
DCE dt cin cnceekoe bere eed ens 
“a 
b. Setting up new professional courses 
c. Non-credit courses .............. 2 
5. Student committees 
a. Working with students in arranging 
(1) Assembly programs ......... 2 
(2) War activities projects....... 2 
(3) Occupational information con- 
DEE isp jedeheekanewnhse 4 
(4) Orientation programs ....... + 
D. Counseling and guidance services....... 5 
1. Undergraduate men ................ 7 


Obtaining and dispensing informa- 
tion about 
(1) Requirements of the various 


branches of the armed services 22 
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WARTIME ACTIVITIES OF PERSONNEL WORKERS 









= IN EDUCATIONAL INSTITUTIONS 
—, ' Number Times 
mes ot Mentioned 
dg (2) Deferment and reserve classi- 
; RPE eee 22 
; (3) Course programs for reserves.. 19 
f (4) Baliements .... «266.2055. 20 
[ (5) Defense courses ............ 4 
i b. Assisting students to make decisions 
' on problems arising out of the war 
by 
fe eer eres 7 
: (2) Educational guidance ....... 10 
: (3) Vocational guidance ........ 10 
; (4) Remedial work ............. 3 
(5) Counseling on personal prob- 
lems including post war plans 5 
: c. Orienting students to college life 
under war conditions........ 5 
: 2. Undergraduate women 
a. Obtaining and dispensing informa- 
f tion about 
r (1) Opportunities for women in 
. war work 
Perera 2 
Bar l 
(2) Defense courses ............ 7 
(3) How and where to serve..... 7 
b. Assisting students to make decisions 
on problems arising out of the war 
through 
O&O Pe en ere + 
(2) Educational guidance ....... 9 
(3) Vocational guidance ........ 11 
c. Counseling on personal problems 
related to men and marriage...... 2 
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Number Times 


Mentioned 
d. Orienting to college life under war 
CEN ce éckcckranveceswhaue de 7 
3. Graduate students .............02.. 2 
SEE prec ee rere 5 
UE, Dios cdnevecnwepeee arene 2 
i ee SI coc ndceteadecs cue 1 
7. High school administrators and coun- 
SE. pa5s0cehabtvAseneevandade kas 4 
8. High school students ............... 3 
E. Extra-curricular activities 
1. Arranging social programs for students 
and men in the military services...... 3 
2. Maintaining programs in sports and 
SOCTORMIONA! SCTIVETRES .. 2.2 6500505.: l 
3. Supervising war-time service projects 
as part of the extra-curricular program 5 
F. Housing 
1. Providing living quarters for military 
units assigned to the campus......... 2 
2. Providing food services for military 
units and regular students with food 
rationing, scarcities, high costs, labor 
EE ck Ca Gna anki eke we eile 2 
3. Making adjustments due to scarcity of 
ee) re 4 
G. Placement 
1. Endeavoring to secure applicants for 
employers’ numerous calls for full- and 
WOTEGMNG WOTTIBES 6 oo occ ccc cccesces 11 


2. Keeping students and alumni informed 
of 
ree eee 


LOD PE ASF 
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WARTIME ACTIVITIES OF PERSONNEL WORKERS 


WARTIME ACTIVITIES OF PERSONNEL WORKERS 








“a Mentioned 
b. Job requirements ............... 5 
c. Job opportunities in public and 
private organizations ............ 6 
3. Administering N.Y.A. aid .......... 3 
4. Making plans for “school and work” 
Es 05-633 v's se See 3 
5. Providing employers information about 
qualifications of applicants.......... 4 
' H. Editorial work 
1. Preparing pamhplets on: 
a. Requirements for military services. 1 
b. Course requirements for reserves.. 1 
c. Preparation for non-military service 1 
De Bee CIID on cca scvincnsnnas | 
e. Opportunities for women......... 5 
, See GD ann csncceensaons | 
g. Job trends and requirements...... l 
I. Supervision and Instruction 
1. Regular courses related to war work.. 10 
2. Specialists courses for the armed 
. SD ciaunwinncddud dhe een seen ey 6 
; Fe SE COME oo kncnncccdcbibs oxex 7 
4. Training courses for child care...... 2 
i 5. Physical education and health programs 1 
) i Se SEED no chi dancekapeees ns 2 
7. Defense nursery schools............. l 
i J. Admissions 
: OS BEC ree rrr ee 4 
; 2. Giving information about 
i Eo 0 oe5 onsen waee 3 
b. Courses for reserves............. 2 
' K. Registrations and records 
Co. icandi sens weenmeta 2 








Number Times 
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WARTIME ACTIVITIES OF PERSONNEL WORKERS 


IN EDUCATIONAL INSTITUTIONS 





Number Times 
Mentioned 


2. Problems arising out of new credit and 
non-credit courses 


eee ee eee ewer eee eene 


L. Research 
De Ed in dinphs enim enh ema tene bes 
2. Personnel techniques ............... 
Be KA Vade ce dasadeneroncaieses 


4. Selection for short courses 
5. Effect of war on maladjusted student. . 


eee ee eevee 


M. Part-time consulting work, special projects 
1. Consulting work with 
a. Armed services 
(1) Advisory to military officers. . 
(2) Selection of personnel 
(3) Training courses 
(4) Recreational programs 
b. Defense industries 
(1) Selection of personnel 
c. Government agencies 
(1) Testing 
(2) Training 
d. Individuals 
e. Professional groups 
2. Special projects 
a. Administrative work 
b. Testing 
c. Training 


N. Off-Campus Committee Work 


1. Service on national, state, or local com- 
mittees and boards 

American Council on Education. . 

National Research Council....... 

State and local councils.......... 

Manpower commission 
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WARTIME ACTIVITIES OF PERSONNEL WORKERS 
IN EDUCATIONAL INSTITUTIONS 





rm orag rho 


Number Times 
Mentioned 


i ee ON oe aces uss 
Professional groups 
Child-care agencies 
Civil service commissions......... 


ee eee re 


64 even eee ee 


' 0. Participation in activities as member of the 


Community 
SE sik hace: dain a 6: wdc Cau pes Me 


il al all taal 


Red Cross 
U.S.O. 


O60 £66 6268 646666 EDL 2S SD OWS CES 


ee ee 
Other service organizations.......... 





TABLE 6 


WORKERS IN EDUCATIONAL INSTITUTIONS 


SUMMARY OF WAR-TIME ACTIVITIES OF PERSONNEL 





Number Times 


Per Cent of 
Total 






Mentioned 

Counseling and Guidances 
I a) rdw cae 6 eee 223 45.93 
re eee 39 8.02 
Ni cai bal 4 aed mda 37 7.61 
Campus committees .......... 32 6.58 
Supervision and instruction.... 29 5.96 
Part-time consulting work..... 29 5.95 
Off-campus committees ....... 23 4.74 
Administration .............. 22 4.53 

Participation as a civilian 
community member ....... 14 2.87 
re 11 2.27 
aed cians ks 9 1.84 
Extra-curricular supervision... 9 1.84 
la ak is peal 6 1.24 
Registration and records...... 3 62 
eee 100.00 
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Although the selective factor of the positions helif 
by the individual replying determines the activities men.) 
tioned, there seems little doubt that counseling of studens} 
is an important and frequently occurring function of 
college personnel workers in wartime. Placement wonf 


also ranks high on the list. 


One needs to keep in mind the fact that these record 
were obtained during the first stage of the transition off 
campuses to a wartime basis and during the period whal 
the male students were in the process of joining the ref 


serves. The draft age had not yet been lowered to eighteen} 
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nteen, F ; ; : ; 
| trustees, and committee chairmen of the various organi- 


' zations which comprise the Council of Guidance and 
' Personnel Associations met during the week end of Janu- 
» ary 15-18, 1943, at the Hotel Biltmore in New York. 
' Inasmuch as the various associations had found it neces- 
' sary to cancel the usual February convention because of 
' travel difficulties, this meeting was planned as a wartime 
) substitute. There was opportunity for the official staffs 
' to meet separately to transact necessary business and to 
| take appropriate action initiated at the general meetings. 











EXECUTIVE MEETING OF THE COUNCIL 
OF GUIDANCE AND PERSONNEL 
ASSOCIATIONS: A REPORT? 


The officers, members of the executive councils or 


Dr. Layton, President of the Board of Representa- 


| tives, defined the task of the group in his invitation to 
| the conference as follows: 


1. To consider war needs in government, business, 
industry, and education which may be met by profes- 
sional personnel services; 


These needs are for adequate counseling for youth to the end 
that they understand their capacities, interests, and aptitudes and 
are aided by wise guidance to find their place in the national 
service, whether in the armed forces or in school or on a job in 
business or industry. This applies to all high school, college, and 
out-of-school youth and to such adults as may be reached by 
guidance and personnel services. 


2. To make a statement of resources available 


» through the Council which are contributing and can 
» contribute further to meeting these needs; 


— — 


*This report was prepared by Helen M. Voorhees. 
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There are about 4,600 professional persons who belong to the 
organizations affiliated with the Council and who are in mor 
or less direct touch with several millions of Americans of school 
and college age and can serve their guidance needs in wartime, 
augmented by certain research and publication facilities which 
keep us in touch periodically with our members and with many 
other persons. 


3. To formulate specific means by which these re. 
sources can be used more widely and more effectively 
in the war effort; 


This means that those of us who are charged with the responsi- 
bilities of leadership of our professional groups must, in confer- 
ferences with each other and with invited Army, Navy, and War 
Manpower Commission representatives, consider the needs, and 
the resources for meeting them, mentioned above, and develop 
improved and possibly new services of guidance for a nation at 
war. Techniques and specific devices for practical use in coun- 
seling will be more important in this discussion than statements 
of objectives or consideration of theories. 


At the various sessions representatives of the Army 
and Navy, of government agencies directly concerned 
with welfare and educational and guidance programs, of 
the War Manpower Commission, and also of industry 
presented their needs and problems. 

The American College Personnel Association was 
represented by Dean E. G. Williamson, President; Dr. 
Daniel Feder, Secretary; Dr. James McClintock, Treas- 
urer; and Miss Helen Voorhees of the Executive Coun- 
cil. Dean Thelma Mills, of the University of Missouri, 
was a member of the Planning Committee for the meet- 
ings. Other members of the American College Personnel 
Association were also in attendance, some in wartime 
Capacities, as representatives of a branch of the military 
service or of industry. 

The subjects presented for discussion dealt with pre- 
service and in-service guidance, wartime health and wel- 
fare services, post-service guidance, post-war educational 
programs, and the techniques which are most likely to 
prove useful in solving the problems which will face all 
counselling groups in the post-war period. 
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EXECUTIVE MEETING 


It is not possible within a limited space to attempt 
any real report upon this series of important meetings. 
A committee has been appointed to edit the verbatim 
proceedings and to publish a complete report as promptly 
as circumstances will allow. It will be of interest to 
American College Personnel Association members to list 
some of the consultants from Government, industry, and 
the military forces, many of whom were in attendance 
for at least a day, frequently longer: 

Lieutenant-Colonel F. J. Agee, Personnel Research Section, War 
Department 


Major Harold C. Bingham, Classification and Enlisted Replace- 
ment Branch, War Department 


Mr. A. F. Hinrichs, Commissioner, Bureau of Labor Statistics 


Mr. Harry Jager, Chief, Occupational Information and Guid- 
ance Service 


Dr. Forrest H. Kirkpatrick, Director of Personnel Research, 
Radio Corporation of America, Camden, New Jersey 


Miss Bertha Nienburg, Assistant Director, Woman’s Bureau 
Ensign Winifred R. Quick, U.S.N.R. 
Miss Helen Ringe, War Manpower Commission 


Dr. Reinhold Schairer, United States Committee on Educa- 
tional Reconstruction 


Mr. Donald Shank, American Council on Education 


Dr. C. L. Shartle, Chief, Occupational Analysis Section, Em- 
ployment Service Division, Bureau of Employment Security 


Dr. Donald C. Tewksbury, Deputy Chief of the Pre-Induction 
Training Section, Civilian Personnel Division, War Depart- 
ment 


Dr. A. L. Threlkeld, National Director, High School Victory 
Corps 
Mrs. Marguerite Zapoleon, Bureau of Occupational Educa- 
tion, United States Office of Education 
Even this incomplete list of consultants indicates that 
busy officials thought it well worth their while to leave 
their offices in order to meet with representatives of the 
guidance organizations. Those in attendance at the meet- 
ings were keenly aware of the value to them and to the 
guidance program of this direct approach to the prob- 


85 





EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 


lems of those who are responsible for an important phase 
of the conduct of the affairs of the country. 

Representatives of both the Army and Navy stressed 
the need for pre-induction guidance: for the sake of the 
draftees or enlisted personnel that they may be promptly 
classified and assigned to posts for which they are best 
fitted ; for the military forces which are in great need of 
trained men and women in various classifications. The 
group representing education and guidance is concerned, 
of course, that training programs shall not be interrupted 
unnecessarily and unwisely. That same group is anxious, 
as are we all, that post-war guidance problems may, so 
far as possible, be anticipated and adequately prepared 
for. In speaking of the reconstruction program of the last 
war, Dr. Schairer pointed out that all educational prog- 
ress has been made during the turbulent post-war periods 
of the world’s history. If history is to repeat itself, there 
will be need for greater and more inspired effort on the 
part of those who by conviction and by training are pre- 
pared to give intelligent guidance to the youth who are 
victims of a war not of their own making. 

Throughout the group attending the meeting there 
was a note of high courage, in the face of the frequently 
reiterated difficulties which confront every phase of edu- 
cation, and a determination to make sure that those who 


fight the country’s battles shall not return to live defeated f 


lives. 
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MEASUREMENT ABSTRACTS* 


Arsenian, Seth. “Own Estimate and Objective Measure- 
ment.” Journal of Educational Psychology, XXXIII 
(1942), 291-302. 


The author is interested in knowing the relationship 
between the freshman’s own estimates and some corre- 
sponding objective measurements on scholastic aptitude, 
achievement, adjustment, and interests; change of rela- 
tionship, if any, between the self-estimates before and 
after the taking of the tests; and finally the characteristics 
of students who grossly over- or under-estimate them- 
selves. The results indicate a wide variation between self- 
estimates and objective measurements. However, the 
former is getting closer to the latter when the rating is 
done after taking the test. Those who over- or under- 


estimate are as a group less intelligent and less well ad- 
justed. K. S. Yum. 





Cronbach, Lee J. “Studies of Acquiescence as a Factor 
in the True-false Test.” Journal of Educational Psy- 
chology, XX XIII (1942), 401-415. 


Studies of the true-false test show “acquiescence”— 
the tendency to mark items true rather than false, when 


| guessing—influences the scores in various ways, and indi- 


cate, particularly, that a test score may be a function of a 
personality trait. It is suggested that more false items be 


| used, since acquiescence makes them the more valid and 





*Edited by Forrest A. Kingsbury. 


87 


EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT 


reliable, that a revised scoring formula be adopted if 
precise results are desired, and that the student be trained 
to be aware of this tendency. L. Bouthilet. 





Flanagan, John C. “The Selection and Classification Pro. 
gram for Aviation Cadets (Aircrew—Bombardiers, 


Pilots, and Navigators).” Journal of Consulting Psy. 
chology, VI (1942), 229-239. 


The high proportion of military aviation candidates 
eliminated every year for “lack of aptitude” during the 
elementary training period emphasizes the urgent need 
in war time of more effective methods of selection and 
classification of aviation cadets. To this end, Psychologi- 
cal Research Units at three Army Air Corps Replace. 
ment Training Centers have been developing tests and 
procedures, which are here described. The use of the 
Aviation Cadet Qualifying Examination eliminates de: 
pendence on formal educational requirements or the 
“equivalent” academic type of educational tests. Those 
who pass the Qualifying Examination are sent to a Clas- 
sification Center where a further battery of aptitude and 
physical tests is used in assigning them to bombardier, 
pilot, or navigator training. An intensive analysis of 1000 


cases of eliminated cadet flyers provides a guide to char- f 


acteristics considered important for success, and to the 
improvement and further development of selective and 
classification tests. F. 4. Kingsbury. 





Fulcher, John S. and Zubin, Joseph, “The Item Anz- 
lyzer: A Mechanical Device for Treating the Four-§ 
Fold Table in Large Samples.” Journal of Applied § 


Psychology, XXVI (1942), 511-522. 


The method requires no computation, hence a mini-F 
mum of labor and time, giving results which approxi § 
mate very closely the computed probability for such® 
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comparisons. It is based on a transformation function 9 
for proportions or percentages such that © = 2 sin-! V p 
in a circle, where p is the proportion or percentage under 
examination. The authors point out the applicability of 
this technique to various situations with minimum labor. 


K.S. Yum. 





Ghiselli, Edwin E. “Tests for the Selection of Inspector- 
Packers.” Journal of Applied Psychology, XXVI 
(1942) , 468-476. 


The inspector-packers in this study are girls em- 
ployed by a pharmaceutical manufacturing company for 
filling, stoppering, examining, labeling, cartoning and 
packaging. A combination of the ratings of the super- 
visor and forelady was used as the criterion of job pro- 
ficiency against the scores on the Minnesota Paper Form 
Board, Pegboard, Minnesota Rate of Manipulation— 
turning, placing—Minnesota Vocational Test for Cleri- 
cal Workers, etc. Some of the validity coefficients were 
reasonably good. A multiple coefficient of correlation is 
reported as high as .72 K. S. Yum. 





Irwin, R. Randell. ““Lockheed’s Full Testing Program.” 
Personnel Journal, XXI (1942), 103-107. 


A battery of tests consisting of the Otis Self-Admin- 
istering Tests of Mental Ability, Higher Forms A, B, 
and D, Johnson O’Connor Wiggly Block, Minnesota 
Manipulative Tests, certain clerical aptitudes, and cer- 
tain trade tests, has been utilized since 1937 when Lock- 
heed Aircraft Corporation found that hardly two out 
of three new employees developed into satisfactory work- 
ers. A definite testing program is instituted for re-evalua- 
tion of active employees for promotion and guidance as 
well as for evaluation of applicants. K. S. Yum. 
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Koenig, Frank J., Major M. C. and Smith, John, Py 
30083518. “A Preliminary Study Using a Short Ob. 
jective Measure for Determining Mental Deficiency 
in Selective Service Registrants.” Journal of Educa. 


tional Psychology, XX XIII (1942) , 443-448. 


A brief oral test was given to registrants claiming 
illiteracy in order to learn if their mental ability was 
sufficiently high for their acceptance by the Army. 
Although no attempt was made to classify subjects as to 
exact mental age, the results of this test compare favor. 
ably with scores on the Kent Emergency Test, indicating 
that a short series of questions on everyday topics can be 
an objective, useful estimate of intelligence. L. Bouthilet, 





Mitrano, Anthony J. “The Relationship Between Age 
and Test Performance of Applicants to a Technical. 
Industrial High School.” Journal of Applied Psy. 
chology, XXVI (1942), 482-486. 


The MacQuarrie Test of Mechanical Ability, the 
Revised Alpha Intelligence Examination (Wells Revi- 
sion No. 7), and the Revised Minnesota Paper Form 
Board Test (Series AA) were given to 389 eighth grade 
pupils who applied for admission into the ninth grade 
of the technical-industrial high school. The results show 
consistently that, out of the age range 13 to 16 inclusive, 
the younger pupils are likely to be the more capable. 
K. S. Yum. 





Moore, Herbert. “Real Use for Rating Scales.” Person- 
nel Journal, XXI (1942), 165-170. 


Ratings are not exact measuring rods. They should 


be used for corrective purposes as specific suggestions. f 


The author calls attention to their place in regard to use, 
contents, and form. A judgment made is an interpreta- 
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tion and qualities judged are abstractions. Suggestions 
are given for improving ratings, showing results of bet- 
ter method, and illustrations of rating scales as clinical 
tools. K. S. Yum. 





Pintner, R. “Intelligence Testing of Partially-Sighted 
Children.” Journal of Educational Psychology, 
XXXIII (1942), 265-272. 


A group of 602 children ranging in chronological age 
from 10 to 12 years inclusive, was tested by the new Re- 
vised Stanford-Binet Test. The visual material of the 
test was enlarged in order to avoid any possible handi- 
cap due to visual defect. Many re-tests at different inter- 
vals were given, some with the standard material, and 
some with the enlarged. The results show that there 
seems to be in general no obvious handicap. The mean 
[.Q. for partially-sighted children is a few points below 
normal. The author, however, recommends the enlarged 
visual material for these children. K. S. Yum. 





Rugg, Donald and Cantril, Hadley. “The Wording of 
Questions in Public Opinion Polls.” Journal of Ab- 
normal and Social Psychology, XXXVII (1942), 
469-495. 


The extent to which the wording of questions influ- 
ences the answers obtained depends on the degree to 
which the respondent has or has not reliable standards 
of judgment resulting in stable frames of reference. 
Numerous studies show a considerable variation directly 
due to effects of context, kinds of alternatives, and devia- 
tions from “objective” wordings. What particular tech- 
nique or techniques should be used is therefore a func- 
tion of the nature of the particular issue under investi- 


| gation. Whenever possible, the split-ballot technique 
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should be used for testing the stability and consistency of 
opinion. K. S. Yum. 





Ryan, T. A. and Johnson, B. R. “Interest Scores in the 
Selection of Salesmen and Servicemen: Occupational 
vs. Ability-Group Scoring Keys.” Journal of Applied 
Psychology, XXVI (1942), 543-562. 


The authors are concerned with the validity of inter. 
est measurement in selecting salesmen and servicemen 
for machine accounting services, and the relative value 
of two distinct kinds of scoring key for the Strong Inter. 
est Blank, the occupational key and the ability-group 
key. The data obtained indicate that the ability-group 
key has definite promise as a selective device in both of 
the occupational groups under investigation, although 
previous investigators have questioned its value. Ratings 
by the district manager and the sales manager are criteria 
of success. K. S. Yum. 





Schneidler, G. G. and Paterson, D. G. “Sex Differences 
in Clerical Aptitude.” Journal of Educational Psy. 
chology, XXXIII (1942), 303-309. 


Tests which involve the checking for identities 
or differences of paired numbers and paired names wert 
given to boys and girls in grades from V to XII inclu- 
sive. The results consistently indicate a striking difference 
between sexes, which is difficult to explain at the present 
time. Some hypotheses are offered. Louise T. Grossnickle. 
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Selover, Robert B. “A Study of the Sophomore Testing kind, 


Program at the University of Minnesota—Part II.” P 
Journal of Applied Psychology, XXVI (1942), 456 
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By means of R. A. Fisher’s discriminant function, it 
is possible to determine the constants in the equation 
which maximizes the difference between any two groups 
and makes use of all the information given by the test 
scores. This technique should be useful in determining 
whether the test performance of a given student resem- 
bles the performance of one group of successful individ- 
uals more closely than that of another group. As illus- 
trations the author reports a comparison of the profiles 
for a group in pre-medical studies and music and a com- 
parison between profiles of groups in natural science and 
English, together with some individual cases for voca- 
tional interpretation. K. S. Yum. 





Smith, A. W. “Observation and Testing.” Personnel 
Journal, XXI (1942), 175-179. 


The Psychometric Laboratory of the Portland Public 
Schools uses a battery of 29 aptitude, interest and tem- 
perament measures accompanying an observation sheet 
taking into consideration anything seeming to be signifi- 
cant in the behavior of the testee. The essential point is 
that a psychological test is more than a measuring device. 
Louise T. Grossnickle. 





Street, Roy F. I.Q. Changes of Exceptional Children. 
Journal of Consulting Psychology, VI (1942), 243- 
246. 


Of 1318 children in the public schools of Battle Creek 
tested since 1931 with the Stanford-Binet (original or 
revised) because of a need of special attention of some 
kind, 920 have been retested at least once. Of this num- 
ber, I.Q. changes of 10 points or more were noted in 43 
cases. These case records were studied with reference to 
available medical, dental, social, psychological, and edu- 
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cational information. Several generalizations about pog 
sible conditions of this variability are mentioned; one 
the shyness or negativism which limited several children§ 
free self-expression on the original test; but no sing 
cause can account for all cases of variation. The need j 
stressed for caution in individual prediction on the bas 
of too limited data. F. 4. Kingsbury. 





Taylor, K. Van F. “The Reliability and Permanence ¢ 
Vocational Interests of Adolescents.” Journal of E 
perimental Education, XI (1942), 81-87. 


The Strong Vocational Interest Blanks for men 
women were given to 64 high school boys and 62 hig 
school girls over a four-year period of seriation testin 
The author finds that the results are similar to those ob 
tained by investigators employing adult and coll 
populations. The reliability and permanence of measure 
interest scores are adequate for use in the upper grade 
of the secondary school. Louise T. Grossnickle. 





Waite, W. H. “The Relationship Between Performance 
on Examinations and Emotional Responses.” Jour 


of Experimental Education, XI (1942), 88-96. 


The data were obtained from 60 boys, three separ 
readings for each physiological function. On the thir 
reading, a written examination consisted of three part 
number series, word completion, and artificial languag 
Four types of study were undertaken. The results indics 
a general pattern of response for some physiologica 
measures and some association of heart and respiratid 
rates with success or failure on examinations of varyifl 
length. Louise T. Grossnickle. 
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